-- Logs begin at Mon 2022-09-12 13:34:01 UTC, end at Mon 2022-09-12 14:34:09 UTC. -- Sep 12 14:04:38.862268 dv-cinder-820027-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 14:04:38.871038 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 14:04:38 2022] *** Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: nodename: dv-cinder-820027-25-iscsi Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: machine: x86_64 Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: clock source: unix Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: pcre jit disabled Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: detected number of CPU cores: 4 Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: current working directory: / Sep 12 14:04:38.873132 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: detected binary path: /usr/bin/uwsgi-core Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: your processes number limit is 47680 Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: your memory page size is 4096 bytes Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: detected max file descriptor number: 2048 Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: lock engine: pthread robust mutexes Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: thunder lock: enabled Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 14:04:38.873735 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 14:04:38.912185 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: Python main interpreter initialized at 0x557a84a249c0 Sep 12 14:04:38.912185 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: python threads support enabled Sep 12 14:04:38.912185 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: your server socket listen backlog is limited to 100 connections Sep 12 14:04:38.912185 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: your mercy for graceful operations on workers is 90 seconds Sep 12 14:04:38.912548 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 14:04:38.912630 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: *** Operational MODE: preforking *** Sep 12 14:04:38.912843 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: *** uWSGI is running in multiple interpreter mode *** Sep 12 14:04:38.912843 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: spawned uWSGI master process (pid: 105610) Sep 12 14:04:38.913032 dv-cinder-820027-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 14:04:38.915638 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 1 (pid: 105611, cores: 1) Sep 12 14:04:38.915638 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 2 (pid: 105612, cores: 1) Sep 12 14:04:38.915638 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 14:04:39.565852 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 14:04:39.583411 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 14:04:40.635928 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:04:40.635928 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Sep 12 14:04:40.636523 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:04:40.636523 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Sep 12 14:04:40.642053 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:04:40.642053 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Sep 12 14:04:40.642479 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:04:40.642479 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Sep 12 14:04:43.117846 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 14:04:43.118377 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 14:04:43.118532 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 14:04:43.118915 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 14:04:43.119186 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 14:04:43.119561 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.119882 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.120083 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 14:04:43.120451 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.120536 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 14:04:43.120632 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.120813 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.120922 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 14:04:43.121121 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.121210 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 14:04:43.121436 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.121522 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 14:04:43.121752 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.121853 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122076 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122170 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122334 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122447 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122645 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122766 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.122987 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-25-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123121 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123308 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123434 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123614 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123755 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.123921 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.124075 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.124235 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.124940 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125093 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125412 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125527 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125719 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.125853 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-25-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126175 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126273 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126486 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126637 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126789 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.126948 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127150 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127283 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127453 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127568 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127775 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.127875 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128082 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128169 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128469 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128584 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128783 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.128880 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129102 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129189 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129405 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129519 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129796 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-25-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.129902 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.130106 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.130199 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.130417 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.130605 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.130748 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131021 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131126 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131369 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131456 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131677 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.131771 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132017 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132109 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-25-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132335 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132519 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132657 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132752 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.132961 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133050 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133295 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133391 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133612 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133701 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.133927 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134022 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134287 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134381 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134612 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134819 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.134936 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.135257 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.135382 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.135577 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.135899 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.136008 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.136216 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.136463 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.136551 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.136814 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.137017 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.137113 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.137428 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.137579 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.137730 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138018 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138107 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138271 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138578 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138666 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.138922 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.139219 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.139358 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.139557 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.139810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.140562 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.140734 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.140885 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141031 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141179 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141333 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141494 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141656 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141809 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.141964 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142111 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142264 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142380 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142472 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142679 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.142769 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143003 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143111 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143311 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143399 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143618 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143709 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.143922 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.144021 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.144228 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.144516 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.144603 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.144841 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.145108 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.145210 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.145462 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.145676 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.145774 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.146074 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.146224 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.146640 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.146743 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.146932 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147088 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147251 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147438 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147604 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147753 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.147902 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148037 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148179 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148353 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148503 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148666 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148827 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.148974 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149134 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149293 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149448 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149594 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149750 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.149887 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150091 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150197 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150319 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150406 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150626 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150717 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.150904 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151017 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151211 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151305 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151519 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151616 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151840 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.151940 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152148 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152238 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152462 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152560 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152769 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.152979 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153077 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153284 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153371 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153589 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153895 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.153982 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.154202 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.154478 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.154572 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.154796 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.155074 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.155182 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.155425 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.155674 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.155761 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.156072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.156262 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.156363 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.156733 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.156865 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157058 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157190 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157381 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157563 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157699 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.157787 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158029 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158129 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158358 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158453 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158671 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158758 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.158997 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159100 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159302 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159404 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159609 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159881 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.159971 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160192 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160283 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160502 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160634 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160822 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.160934 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161131 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161230 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161435 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161533 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161751 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.161855 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162049 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162158 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162351 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162448 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162664 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162761 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.162988 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163085 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163289 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163396 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163590 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163696 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.163914 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164021 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164192 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164288 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164494 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164599 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164790 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.164886 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165090 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165186 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165385 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165497 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165687 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165782 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.165993 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166089 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166293 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166398 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166593 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166687 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.166916 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167015 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167232 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167345 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167538 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.167845 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.167984 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.168167 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:04:43.168264 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.168500 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.168594 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.168829 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.168936 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169157 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169253 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169470 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169566 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169784 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.169893 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170117 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170222 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170411 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170510 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170720 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.170830 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.171052 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.171148 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.171906 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172001 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172221 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172331 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172531 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172625 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172851 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.172956 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173163 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173268 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173477 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173581 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173793 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.173902 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174105 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174211 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174420 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174514 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174739 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.174863 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175075 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175188 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175385 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175481 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175710 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.175804 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176033 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176144 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176346 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176451 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176665 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176766 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.176983 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177080 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177295 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177393 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177604 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177712 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.177911 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178058 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178239 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178335 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178554 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178651 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178871 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.178976 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179193 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179290 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179503 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179599 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179823 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.179927 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180171 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180268 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180440 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180550 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180744 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.180835 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181052 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181144 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181359 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181462 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181667 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181758 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.181979 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182081 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182292 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182455 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182598 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182745 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.182989 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183136 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183308 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183464 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183605 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183755 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.183893 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184030 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184199 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184420 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184569 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184707 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184844 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.184989 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185141 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185305 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185450 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185594 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185734 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.185871 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186017 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186156 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186300 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186438 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186574 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.186712 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.187492 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.187647 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.187798 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.187936 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188258 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188406 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188544 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188682 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188828 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.188975 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189123 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189262 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189407 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189563 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189702 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189839 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.189992 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.190133 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.190355 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.190500 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.190646 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.190799 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191002 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191155 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191294 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191439 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191589 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191728 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.191878 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192018 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192155 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192292 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192429 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192582 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192734 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.192880 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193020 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193166 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193311 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193468 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193607 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193744 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.193881 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.194027 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.194173 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.194321 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.194459 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.194604 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195038 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195194 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195334 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195491 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195661 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195806 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.195993 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196146 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196295 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196434 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196613 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196758 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.196939 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197083 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197232 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197369 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197516 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197671 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197824 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.197963 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198155 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198307 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198454 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198592 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198737 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.198916 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199213 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199351 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199498 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199644 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199791 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.199936 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200083 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200229 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200528 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200676 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200815 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.200952 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201089 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201227 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201375 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201524 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201663 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201801 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.201937 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202081 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202248 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202422 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202575 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202713 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.202907 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203053 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203229 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203386 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203525 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203662 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203830 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.203981 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204129 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204268 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204413 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204552 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204723 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.204868 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205015 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205164 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205330 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205475 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205638 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205781 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.205953 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206103 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206242 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206378 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206555 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206717 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.206891 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207036 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207184 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207321 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207495 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207656 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207805 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.207943 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208104 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208285 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208434 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208580 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208719 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.208864 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209003 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209176 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209320 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209496 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209820 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.209963 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210131 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210275 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210447 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210592 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210757 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.210927 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211069 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211226 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211366 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211505 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211675 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211818 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.211987 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212139 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212278 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212414 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212587 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212729 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.212897 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213116 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213267 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213403 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213541 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213676 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213813 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.213958 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214097 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214232 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214412 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214556 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214702 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.214866 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215021 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215185 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215325 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215462 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215608 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215746 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.215883 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216020 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216189 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216334 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216481 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216619 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216790 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.216944 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217081 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217219 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217366 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217504 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217677 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217821 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.217973 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.218234 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.218496 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.218728 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.218923 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219084 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219237 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219390 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219543 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219682 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219819 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.219963 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220103 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220249 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220397 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220535 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220680 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220860 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.220998 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221160 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221300 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221446 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221593 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221737 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.221875 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222021 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222159 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222295 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222441 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222587 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222743 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.222903 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223057 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223195 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223340 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223490 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223638 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223783 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.223921 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224066 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224204 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224341 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224488 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224626 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224774 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.224920 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225058 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225202 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225349 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225495 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225634 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225782 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.225928 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226079 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226217 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226362 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226500 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226658 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226796 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.226982 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227122 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227259 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227403 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227540 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227686 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227833 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.227978 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228118 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228255 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228392 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228589 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228737 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.228876 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229013 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229150 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229287 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229433 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229570 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229708 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229853 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.229990 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.230127 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.230303 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.230459 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.230621 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.230766 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231049 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231202 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231380 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231532 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231704 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.231861 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232000 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232137 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232305 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232469 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232620 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232767 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.232914 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.233085 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.233230 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.233415 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.233569 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.234245 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.234395 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.234532 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.234676 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.234893 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235073 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235214 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235352 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235490 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235639 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235777 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.235927 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236066 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236222 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236360 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236498 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236715 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.236856 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237002 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237140 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237276 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237414 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237564 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237702 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.237982 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238121 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238257 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238407 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238586 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238742 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.238913 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239056 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239204 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239351 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239490 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239634 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.239781 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240127 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240282 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240423 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240561 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240699 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240847 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.240992 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241141 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241280 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241418 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241562 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241700 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241845 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241993 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.241993 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242255 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242393 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242537 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242694 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242853 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.242999 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243136 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243283 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243430 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243578 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243750 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.243901 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244047 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244185 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244346 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244499 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244649 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244787 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.244924 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245060 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245204 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245351 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245512 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245656 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245816 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.245960 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246106 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246245 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246396 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246541 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246679 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.246824 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247043 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247191 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247337 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247475 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247613 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247757 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.247911 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248050 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248196 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248342 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248487 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248679 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248838 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.248978 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.249115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.249280 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.249947 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250096 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250236 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250374 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250511 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250649 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250799 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.250977 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251133 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251279 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251417 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251554 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251702 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251850 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.251989 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252126 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252265 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252442 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252588 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252748 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.252889 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253065 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253209 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253378 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253532 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253679 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253817 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.253955 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254100 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254246 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254392 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254531 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254679 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.254824 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255007 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255156 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255304 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255444 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255591 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255730 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.255868 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256007 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256292 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256440 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256577 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256714 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.256860 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257001 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257138 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257275 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257420 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257559 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257704 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257843 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.257980 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258119 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258322 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258475 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258624 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258809 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.258980 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259118 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259266 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259413 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259560 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259707 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.259878 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260023 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260169 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260316 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260463 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260610 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260771 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.260922 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261062 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261215 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261362 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261501 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261667 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261812 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.261976 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262129 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262279 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262417 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262553 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262690 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.262884 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263045 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263185 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263337 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263476 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263621 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263788 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.263946 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264125 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264281 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264427 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264574 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264788 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.264957 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265101 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265247 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265394 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265540 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265832 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.265969 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266119 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266265 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266411 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266559 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266698 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.266888 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267044 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267182 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267319 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267467 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267605 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267742 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.267880 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268035 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268186 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268331 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268470 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268615 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268796 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.268945 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269093 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269232 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269378 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269516 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269661 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269807 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.269963 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270109 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270248 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270391 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270536 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270675 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270820 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.270993 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271142 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271294 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271433 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271580 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271719 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.271866 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272003 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272139 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272275 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272420 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272568 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272706 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.272849 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273011 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273155 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273307 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273455 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273605 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273744 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.273995 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274139 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274285 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274423 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274595 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274738 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.274943 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275098 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275245 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275383 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275521 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275676 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275822 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.275969 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276108 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276246 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276391 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276537 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276682 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276829 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.276968 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277106 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277243 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277420 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277578 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277726 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.277865 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278003 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278214 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278358 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278505 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278644 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.278805 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279016 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279217 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279360 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279525 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279663 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279800 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.279944 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280115 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280264 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280412 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280570 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280771 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.280923 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281062 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281231 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281380 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281530 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281677 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281842 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.281987 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282154 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282298 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282466 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282630 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282785 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.282987 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283133 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283289 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283444 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283601 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283747 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.283891 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284034 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284178 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284332 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284478 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284622 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284765 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.284918 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285063 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285220 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285366 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285521 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285665 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285816 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.285968 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286123 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286278 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286424 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286568 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286720 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.286901 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287060 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287213 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287406 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287565 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287719 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.287878 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288024 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288168 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288312 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288457 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288755 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.288900 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289091 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289243 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289401 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289547 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289700 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289846 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.289989 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290133 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290277 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290435 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290581 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290725 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.290929 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291082 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291226 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291389 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291535 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291681 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291825 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.291976 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292121 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292274 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292427 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292572 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292716 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.292860 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293003 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293156 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293311 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293456 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293610 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293756 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.293908 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294054 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294198 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294349 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294494 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294639 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294793 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.294967 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295124 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295269 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295413 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295568 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295723 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.295870 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.296014 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.296673 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.296826 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.296979 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297133 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297285 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297431 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297586 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297729 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.297884 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298029 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298182 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298327 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298471 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298615 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298769 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.298943 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299127 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299276 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299420 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299586 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299747 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.299895 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300047 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300192 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300337 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300480 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300787 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.300932 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301076 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301220 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301384 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301529 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301680 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301825 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.301968 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302271 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302418 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302568 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302713 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.302911 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303062 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303259 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303424 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303569 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303713 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.303857 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304000 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304157 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304304 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304448 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304592 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304736 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.304893 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305039 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305183 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305340 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305486 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305630 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305783 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.305928 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306216 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306360 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306504 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306656 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306801 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.306974 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307119 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307284 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307430 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307584 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307729 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.307729 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308002 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308145 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308298 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308444 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308586 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308738 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.308882 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309037 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309228 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309378 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309522 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309670 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309818 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.309962 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310181 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310327 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310472 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310616 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.310998 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.311168 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.311320 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.311467 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.311612 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.311743 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.312426 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.312597 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.312692 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.312914 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313005 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313228 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313330 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313539 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313629 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313851 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.313949 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314257 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314474 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314568 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314784 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.314891 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315139 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315238 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315451 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315539 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315759 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.315897 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316067 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316157 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316378 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316466 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316689 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316793 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.316996 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317084 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317303 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317392 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317612 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317785 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.317920 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318010 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318233 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318320 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318549 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318878 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.318983 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.319194 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.319406 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.319567 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.319964 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320115 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320266 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320411 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320556 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320710 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.320892 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321041 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321186 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321340 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321495 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321647 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321829 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.321977 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322123 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322273 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322428 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322598 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322745 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.322906 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323069 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323214 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323386 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323589 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323740 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.323885 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324037 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324183 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324336 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324482 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324635 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324780 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.324923 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325081 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325236 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325400 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325545 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325689 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.325839 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326049 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326200 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326345 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326489 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326654 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326806 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.326992 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327139 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327302 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327474 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327621 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327766 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.327923 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328069 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328213 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328381 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328533 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328687 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.328869 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329018 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329275 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329474 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329620 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329773 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.329960 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330110 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330255 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330413 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330558 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330723 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.330892 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331077 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331236 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331396 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331553 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331706 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331851 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.331996 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332140 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332284 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332441 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332587 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332732 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.332876 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333019 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333163 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333339 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333492 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333637 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333780 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.333930 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334075 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334228 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334374 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334517 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334669 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.334883 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335036 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335192 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335356 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335509 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335656 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335800 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.335952 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336097 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336240 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336384 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336534 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336688 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336846 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.336992 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337136 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337303 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337449 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337593 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337747 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.337892 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338036 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338180 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338331 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338475 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338627 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338772 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.338949 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339095 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339263 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339458 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339617 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339762 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.339907 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340051 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340051 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340333 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340478 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340630 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340774 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.340919 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341062 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341230 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341375 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341528 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341674 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341818 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.341962 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342114 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342259 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342404 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342548 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342692 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.342863 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343047 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343215 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343361 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343528 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343682 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.343871 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344032 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344187 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344331 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344475 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344619 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344779 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.344935 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345098 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345244 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345389 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345541 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345687 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.345983 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.346128 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.346272 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.346494 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.346643 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.346787 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347004 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347298 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347455 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347746 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.347891 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348035 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348189 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348342 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348488 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348632 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348776 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.348930 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349085 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349230 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349385 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349553 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349707 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.349852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350006 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350151 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350298 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350442 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350586 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350752 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.350923 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351071 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351215 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351372 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351525 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351678 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351823 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.351968 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352112 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352263 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352416 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352571 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352736 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.352881 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353025 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353168 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353312 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353470 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353616 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353759 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.353904 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354058 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354217 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354363 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354524 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354668 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.354997 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355154 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355312 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355457 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355632 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355785 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.355930 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356074 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356227 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356373 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356528 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356673 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356818 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.356976 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357123 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357265 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357417 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357562 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357714 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.357867 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.358020 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.358193 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.358353 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.358515 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359202 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359397 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359550 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359696 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359841 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.359985 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360143 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360289 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360433 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360577 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360721 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.360877 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361030 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361176 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361336 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361488 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361634 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361785 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.361942 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362088 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362231 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362376 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362527 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362673 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.362870 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363025 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363171 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363315 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363471 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363631 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363778 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.363931 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364113 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364261 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364406 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364563 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364709 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.364873 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365019 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365164 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365308 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365479 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365626 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365771 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.365915 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366059 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366356 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366501 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366646 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366801 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.366975 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367133 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367133 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367418 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367570 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367723 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.367910 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368074 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368074 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368358 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368503 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368658 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368810 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.368965 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369119 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369266 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369411 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369555 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369707 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.369861 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370006 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370150 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370295 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370440 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370604 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370757 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.370958 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371116 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371263 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371407 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371560 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371705 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371849 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.371993 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372136 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372280 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372445 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372590 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372734 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.372878 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373022 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373180 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373326 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373471 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373621 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373767 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.373911 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.374064 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.374219 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.375925 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376024 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376098 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376184 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376334 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376427 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376496 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376571 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.376656 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377008 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377008 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377146 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377214 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377280 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377346 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377421 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377490 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377579 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377662 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377742 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.377898 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378072 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378221 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378366 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378529 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378677 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.378886 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.379040 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.379193 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.379337 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.379482 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 14:04:43.379637 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.379870 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.380212 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.380530 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.380860 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.381191 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.381538 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.381853 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.382197 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.382530 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.382863 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.383185 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.383494 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:04:43.383742 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 14:04:43.536270 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Registered counter for database nova_api Sep 12 14:04:43.541201 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Registered counter for database nova_api Sep 12 14:04:43.558973 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.561460 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.565657 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.568016 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.622250 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.context [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294b7baa-bea0-4a69-9ea0-7bb098aa05ae(cell1) {{(pid=105611) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 14:04:43.624703 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.context [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294b7baa-bea0-4a69-9ea0-7bb098aa05ae(cell1) {{(pid=105612) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 14:04:43.626082 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:04:43.626551 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:04:43.628130 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:04:43.628539 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:04:43.628838 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:04:43.629012 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:04:43.629279 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:04:43.630568 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:04:43.631319 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:04:43.631418 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:04:43.631768 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:04:43.633295 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Registered counter for database nova_cell0 Sep 12 14:04:43.633740 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:04:43.635824 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Registered counter for database nova_cell0 Sep 12 14:04:43.637270 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Registered counter for database nova_cell1 Sep 12 14:04:43.639936 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Registered counter for database nova_cell1 Sep 12 14:04:43.644511 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.645655 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.647804 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.649688 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.652714 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.654166 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.654917 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.794156 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.804373 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Registered counter for database nova_cell0 Sep 12 14:04:43.804634 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Registered counter for database nova_cell0 Sep 12 14:04:43.813427 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.816672 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:04:43.820580 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:43.821730 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:04:44.157127 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:04:44.157795 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:04:44.164470 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:04:44.164583 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:04:44.503240 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:04:44.505026 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:04:44.509255 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:04:44.510934 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:04:44.514521 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a84a249c0 pid: 105612 (default app) Sep 12 14:04:44.517112 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a84a249c0 pid: 105611 (default app) Sep 12 14:04:44.517376 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:04:44.518577 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-356774bf-9382-4fe5-9ad9-11de37c98556 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001963 Sep 12 14:04:44.519023 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Sep 12 14:04:44 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:05.374114 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:05.375353 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Sep 12 14:06:05.375745 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:05.387536 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:05.388665 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:05.389924 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell1:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:05.390691 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:06.282226 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-275199d5-4959-42e5-ba80-6d8a2bbd1e97 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:06.315589 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-275199d5-4959-42e5-ba80-6d8a2bbd1e97 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933705 Sep 12 14:06:06.316348 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 12 14:06:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:08.960385 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:08.961384 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-89a74d66-52d6-42f7-9b2b-e9dccab6e88f None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 12 14:06:08.963129 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:09.408608 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7279acac-97bc-42a3-9875-cd232545e2ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:09.456430 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7279acac-97bc-42a3-9875-cd232545e2ed admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487612 Sep 12 14:06:09.456990 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:09.672505 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f910925d-adec-4750-a4a7-5abd2bd17bae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:09.679000 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:09.680022 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:09.680718 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:09.681409 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:09.747653 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-f910925d-adec-4750-a4a7-5abd2bd17bae admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282301 Sep 12 14:06:09.748276 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 12 14:06:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:12.338211 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7279acac-97bc-42a3-9875-cd232545e2ed admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:12.339262 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7279acac-97bc-42a3-9875-cd232545e2ed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 12 14:06:12.339699 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:12.973020 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-7d0435d7-b3ac-4391-9fe5-e15ef8de4de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:13.014577 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-7d0435d7-b3ac-4391-9fe5-e15ef8de4de9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.668636 Sep 12 14:06:13.015378 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:06:13.028038 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-37d70d3f-b1e6-4ed3-9bf5-5c3e2c1c2180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:13.066058 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-37d70d3f-b1e6-4ed3-9bf5-5c3e2c1c2180 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042483 Sep 12 14:06:13.066927 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 12 14:06:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:06:15.680203 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-7d0435d7-b3ac-4391-9fe5-e15ef8de4de9 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:15.681224 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-7d0435d7-b3ac-4391-9fe5-e15ef8de4de9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 12 14:06:15.681634 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:16.101679 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-5dcf2026-5c5d-47f7-95cb-ab157c76c8a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:16.124403 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-5dcf2026-5c5d-47f7-95cb-ab157c76c8a1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435848 Sep 12 14:06:16.124955 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:16.138050 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d3feb560-e867-422b-a365-d4dd5771af21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:16.166826 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d3feb560-e867-422b-a365-d4dd5771af21 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033323 Sep 12 14:06:16.168025 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 12 14:06:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:06:18.779821 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-5dcf2026-5c5d-47f7-95cb-ab157c76c8a1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:18.780825 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-5dcf2026-5c5d-47f7-95cb-ab157c76c8a1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 12 14:06:18.781399 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:19.192314 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-6cc07e4b-ba6d-4b7a-b51d-57efa004979b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:19.211708 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-6cc07e4b-ba6d-4b7a-b51d-57efa004979b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424268 Sep 12 14:06:19.212399 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:19.225264 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-868f9b7a-2564-4504-a086-4385eaa016b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:19.252451 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-868f9b7a-2564-4504-a086-4385eaa016b4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030879 Sep 12 14:06:19.253019 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 12 14:06:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:21.895097 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-6cc07e4b-ba6d-4b7a-b51d-57efa004979b admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:21.896979 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-6cc07e4b-ba6d-4b7a-b51d-57efa004979b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002891 Sep 12 14:06:21.897827 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:22.360852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:22.383422 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474421 Sep 12 14:06:22.384101 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:06:22.399090 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-dab5cfe2-eeaa-4603-ac33-a26911525719 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:22.431321 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-dab5cfe2-eeaa-4603-ac33-a26911525719 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036940 Sep 12 14:06:22.431907 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 12 14:06:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:25.096215 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:25.097450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Sep 12 14:06:25.097997 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:25.517703 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-76ea5d47-19e6-4a3c-8a97-1ef7159bd840 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:25.542752 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-76ea5d47-19e6-4a3c-8a97-1ef7159bd840 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438730 Sep 12 14:06:25.543354 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 12 14:06:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:06:28.137761 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:28.139367 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-788cc6b1-0714-44df-9be0-5144f373799b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Sep 12 14:06:28.139939 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:28.579869 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9f62a68c-2688-4b1f-8cb8-6a8889411367 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:28.598508 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-9f62a68c-2688-4b1f-8cb8-6a8889411367 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.451891 Sep 12 14:06:28.599087 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:28.611133 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-aba41279-3a41-42ef-b63e-080031e6311a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:28.641225 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-aba41279-3a41-42ef-b63e-080031e6311a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033603 Sep 12 14:06:28.642299 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 12 14:06:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:06:31.336386 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9f62a68c-2688-4b1f-8cb8-6a8889411367 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:31.337395 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-9f62a68c-2688-4b1f-8cb8-6a8889411367 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 12 14:06:31.337946 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:31.746457 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-36ac5c42-ef96-46d8-92d8-9d10d2491925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:31.766021 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-36ac5c42-ef96-46d8-92d8-9d10d2491925 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421523 Sep 12 14:06:31.766578 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:06:31.778577 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-27bd9c58-f086-4e23-9987-7440e876d315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:31.802561 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-27bd9c58-f086-4e23-9987-7440e876d315 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027679 Sep 12 14:06:31.803165 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 12 14:06:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:34.395061 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-36ac5c42-ef96-46d8-92d8-9d10d2491925 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:34.396097 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-36ac5c42-ef96-46d8-92d8-9d10d2491925 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 12 14:06:34.396501 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:34.796298 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a5d07883-e464-4dd6-b78f-b3f6905364ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:34.817833 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a5d07883-e464-4dd6-b78f-b3f6905364ec admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.414059 Sep 12 14:06:34.818627 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:34.830857 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-e6bb9858-ff5f-47b3-b12a-ec916ea94516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:34.855978 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-e6bb9858-ff5f-47b3-b12a-ec916ea94516 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028805 Sep 12 14:06:34.856565 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 12 14:06:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:37.499320 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a5d07883-e464-4dd6-b78f-b3f6905364ec admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:37.500300 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a5d07883-e464-4dd6-b78f-b3f6905364ec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 12 14:06:37.500718 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:37.971746 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c8f4a26e-ebb6-412b-b36d-1cc113c72a23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:37.979969 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:38.003259 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c8f4a26e-ebb6-412b-b36d-1cc113c72a23 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.495619 Sep 12 14:06:38.004069 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:38.016792 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-c1255047-a60b-43eb-a04e-cb9c6f3da67e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:38.045827 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-c1255047-a60b-43eb-a04e-cb9c6f3da67e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032773 Sep 12 14:06:38.046407 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 12 14:06:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:06:40.776253 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c8f4a26e-ebb6-412b-b36d-1cc113c72a23 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:06:40.777284 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c8f4a26e-ebb6-412b-b36d-1cc113c72a23 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Sep 12 14:06:40.777688 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:06:41.223263 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:41.229735 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:06:41.245463 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461805 Sep 12 14:06:41.246202 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 12 14:06:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:06:41.257954 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f5108792-c34f-46e9-ab03-8ae666b01e59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:06:41.285734 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f5108792-c34f-46e9-ab03-8ae666b01e59 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031354 Sep 12 14:06:41.286693 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 12 14:06:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:07:02.453692 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:02.454609 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 12 14:07:02.455044 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:02.465353 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:07:02.841620 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-121406a6-4cb6-4982-9c88-30a0798e172d admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:02.860011 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-121406a6-4cb6-4982-9c88-30a0798e172d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399088 Sep 12 14:07:02.860537 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 12 14:07:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:04.153592 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:04.154596 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2c499e60-fcd0-4c7f-8e10-a2b8f12cba41 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 12 14:07:04.155025 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:04.671832 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-cae3b7e5-19f4-42d4-9cd4-4fd305ef32da admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:04.677175 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-cae3b7e5-19f4-42d4-9cd4-4fd305ef32da admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-cae3b7e5-19f4-42d4-9cd4-4fd305ef32da admin admin] Request method failure captured: Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Host: 10.222.0.42 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjHz0IM74z7-QYWPPucVBsrEKQMqbGbErMh7ST1H-A59kbXNb46y1ZEIzcTcqcbyOGbSBXX-SaGqGxG2tgpm00CHomEHraGJAKOH9GiKozRmZICaDruhJKoSr-tA-OHvnYlZqOJ2IC1jZoKF4KdYvM2mgUrKVb7NBlDkWBGrCWcbE0RAU Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Role: admin,reader,member Sep 12 14:07:04.680385 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Roles: admin,reader,member Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User: admin Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: method: > Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: exception: Flavor 42 could not be found. Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: action_args: {'id': '42'} Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:04.681810 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:04.682686 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.684153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-cae3b7e5-19f4-42d4-9cd4-4fd305ef32da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:04.685442 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-cae3b7e5-19f4-42d4-9cd4-4fd305ef32da admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392746 Sep 12 14:07:04.685442 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 12 14:07:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:04.691966 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-c308724b-5a70-449d-bea4-1b2491208576 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:04.714719 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-c308724b-5a70-449d-bea4-1b2491208576 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026707 Sep 12 14:07:04.715284 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:07:04.725677 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-15ae7684-c501-4072-9a98-e5f16f1b0cb2 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:04.747793 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-15ae7684-c501-4072-9a98-e5f16f1b0cb2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026529 Sep 12 14:07:04.748336 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:04.757537 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e2add903-79c4-45fc-82a9-1b7ba5ed0439 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:04.762859 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-e2add903-79c4-45fc-82a9-1b7ba5ed0439 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e2add903-79c4-45fc-82a9-1b7ba5ed0439 admin admin] Request method failure captured: Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Host: 10.222.0.42 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjHz0IM74z7-QYWPPucVBsrEKQMqbGbErMh7ST1H-A59kbXNb46y1ZEIzcTcqcbyOGbSBXX-SaGqGxG2tgpm00CHomEHraGJAKOH9GiKozRmZICaDruhJKoSr-tA-OHvnYlZqOJ2IC1jZoKF4KdYvM2mgUrKVb7NBlDkWBGrCWcbE0RAU Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Role: admin,reader,member Sep 12 14:07:04.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Roles: admin,reader,member Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User: admin Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: method: > Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: exception: Flavor 42 could not be found. Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: action_args: {'id': '42'} Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:04.767642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:04.768552 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:04.769602 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e2add903-79c4-45fc-82a9-1b7ba5ed0439 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:04.770578 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-e2add903-79c4-45fc-82a9-1b7ba5ed0439 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013467 Sep 12 14:07:04.770578 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 12 14:07:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 12 14:07:05.976814 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-15ae7684-c501-4072-9a98-e5f16f1b0cb2 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:05.978321 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-15ae7684-c501-4072-9a98-e5f16f1b0cb2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 12 14:07:05.978729 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:07:06.606655 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9a75809e-eacc-47f8-a3ce-44aade2d26ba admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:06.611626 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-9a75809e-eacc-47f8-a3ce-44aade2d26ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9a75809e-eacc-47f8-a3ce-44aade2d26ba admin admin] Request method failure captured: Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Host: 10.222.0.42 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjHz0JyKRlu-EBc-NHDhhkCTkctiFEpWHC0kcZyC2fwRUDUovtBvZiP3R8vrNiQwz4cPohnhiXEkr3eVYMLcUoWFL1XJanZGLtF5qFSvr3u0_YTr4UutVCJO4F4Ejah_lGDahrwL-M7ESa_TurkcaRHCFyZ48jjClLEhR0UR2eF6QU8M0 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Role: admin,reader,member Sep 12 14:07:06.613115 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Roles: admin,reader,member Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User: admin Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: method: > Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: exception: Flavor 84 could not be found. Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: action_args: {'id': '84'} Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:06.614640 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:06.615642 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.617113 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9a75809e-eacc-47f8-a3ce-44aade2d26ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:06.618548 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-9a75809e-eacc-47f8-a3ce-44aade2d26ba admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.498277 Sep 12 14:07:06.618548 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 12 14:07:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:06.624840 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f1251dff-36a0-4022-b131-38bbe7b73edd admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:06.639717 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f1251dff-36a0-4022-b131-38bbe7b73edd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018442 Sep 12 14:07:06.640175 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:06.649283 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-aec9a9a4-c359-4d45-b00d-e92571c96057 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:06.664336 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-aec9a9a4-c359-4d45-b00d-e92571c96057 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018542 Sep 12 14:07:06.664858 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:06.674364 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-5d9ebee1-fb2c-4ae3-9194-cb985e91ad6a admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:06.679394 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-5d9ebee1-fb2c-4ae3-9194-cb985e91ad6a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-5d9ebee1-fb2c-4ae3-9194-cb985e91ad6a admin admin] Request method failure captured: Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Host: 10.222.0.42 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjHz0JyKRlu-EBc-NHDhhkCTkctiFEpWHC0kcZyC2fwRUDUovtBvZiP3R8vrNiQwz4cPohnhiXEkr3eVYMLcUoWFL1XJanZGLtF5qFSvr3u0_YTr4UutVCJO4F4Ejah_lGDahrwL-M7ESa_TurkcaRHCFyZ48jjClLEhR0UR2eF6QU8M0 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Role: admin,reader,member Sep 12 14:07:06.682203 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Roles: admin,reader,member Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User: admin Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: method: > Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: exception: Flavor 84 could not be found. Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: action_args: {'id': '84'} Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:06.683838 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:06.684852 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:06.686200 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-5d9ebee1-fb2c-4ae3-9194-cb985e91ad6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:06.687440 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-5d9ebee1-fb2c-4ae3-9194-cb985e91ad6a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012736 Sep 12 14:07:06.687440 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 12 14:07:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:07.911592 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-aec9a9a4-c359-4d45-b00d-e92571c96057 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:07.912591 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-aec9a9a4-c359-4d45-b00d-e92571c96057 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 12 14:07:07.912979 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:08.435343 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c1c5e477-2252-44e1-9956-0662aabeb233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:08.441143 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-c1c5e477-2252-44e1-9956-0662aabeb233 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c1c5e477-2252-44e1-9956-0662aabeb233 admin admin] Request method failure captured: Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Host: 10.222.0.42 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjHz0LjsAOpFHTKnhpStCMDCU_S0Z5IpWDheUusdriB5SwcuV_xlo032jrHuiaLITFoCOgf4QkirCmsbyTWkHDQCNHruD4b19jgQ4X-yqGJNxI-jwxaIpvIvS2ERZ_76wL_RbPzwirjyGXS_7WQRJ5uCWkbDI8VqJ7rb0wSEtkWtDEOtc Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Role: admin,reader,member Sep 12 14:07:08.442664 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Roles: admin,reader,member Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User: admin Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: method: > Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: exception: Flavor 451 could not be found. Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: action_args: {'id': '451'} Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:08.444450 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:08.445389 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.447300 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-c1c5e477-2252-44e1-9956-0662aabeb233 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:08.448544 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-c1c5e477-2252-44e1-9956-0662aabeb233 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397473 Sep 12 14:07:08.448544 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:07:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:08.455585 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2512f777-04f9-4f70-9ae7-5f25658583df admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:08.470297 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2512f777-04f9-4f70-9ae7-5f25658583df admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018596 Sep 12 14:07:08.470826 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:08.479928 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:08.494916 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018419 Sep 12 14:07:08.495424 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 12 14:07:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:07:08.504344 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9d86adbe-65a1-4129-be05-d87d0835b525 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:08.509782 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-9d86adbe-65a1-4129-be05-d87d0835b525 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9d86adbe-65a1-4129-be05-d87d0835b525 admin admin] Request method failure captured: Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Host: 10.222.0.42 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjHz0LjsAOpFHTKnhpStCMDCU_S0Z5IpWDheUusdriB5SwcuV_xlo032jrHuiaLITFoCOgf4QkirCmsbyTWkHDQCNHruD4b19jgQ4X-yqGJNxI-jwxaIpvIvS2ERZ_76wL_RbPzwirjyGXS_7WQRJ5uCWkbDI8VqJ7rb0wSEtkWtDEOtc Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Role: admin,reader,member Sep 12 14:07:08.511293 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Roles: admin,reader,member Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b159fcc4f05d45de88c679e235640813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b159fcc4f05d45de88c679e235640813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b159fcc4f05d45de88c679e235640813", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Id: b159fcc4f05d45de88c679e235640813 Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User: admin Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Id: e46b19c26ed14ce08997d6b7fd3a2efb Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: method: > Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: exception: Flavor 451 could not be found. Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: action_args: {'id': '451'} Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:07:08.512794 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:08.513722 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 12 14:07:08.515072 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-9d86adbe-65a1-4129-be05-d87d0835b525 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:07:08.516306 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-9d86adbe-65a1-4129-be05-d87d0835b525 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011770 Sep 12 14:07:08.516306 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:07:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 14:07:09.715397 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:09.716431 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 12 14:07:09.716845 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:10.235513 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-03548133-2175-49e5-aefe-d86f3eab594c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:07:10.255020 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-03548133-2175-49e5-aefe-d86f3eab594c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401718 Sep 12 14:07:10.255553 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 12 14:07:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:07:11.468073 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:11.469080 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 12 14:07:11.469478 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:11.983953 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-27a59bbd-e5c9-4b1b-ad93-1f3355f270d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:07:12.003271 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-27a59bbd-e5c9-4b1b-ad93-1f3355f270d9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397536 Sep 12 14:07:12.003816 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 12 14:07:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:07:13.208145 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:13.209153 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 12 14:07:13.209542 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:13.720173 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-1b6cdf5e-5345-4e68-9d1a-43a8d3cca812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:07:13.738459 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-1b6cdf5e-5345-4e68-9d1a-43a8d3cca812 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393157 Sep 12 14:07:13.739039 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 12 14:07:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:07:14.957772 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:14.958775 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 12 14:07:14.959204 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:15.474061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-1c574696-5b03-48c6-a27e-a5092a9e0d67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:07:15.491868 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-1c574696-5b03-48c6-a27e-a5092a9e0d67 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396907 Sep 12 14:07:15.492386 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 12 14:07:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:07:16.707256 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:16.708265 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 12 14:07:16.708674 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:07:17.220708 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2176c7cd-9233-43db-9628-c3d34cb891ee admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:07:17.241742 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2176c7cd-9233-43db-9628-c3d34cb891ee admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396217 Sep 12 14:07:17.242675 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Sep 12 14:07:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:08:13.668206 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:13.669235 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6e931b3a-a3b8-4261-a130-a4984a607bd0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 12 14:08:13.669631 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 12 14:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:08:13.680203 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:14.050088 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f7330573-ca65-49ca-87fc-a7303681da34 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:14.071087 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-f7330573-ca65-49ca-87fc-a7303681da34 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395388 Sep 12 14:08:14.071617 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 12 14:08:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:08:14.092562 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=14 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:08:14.096241 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-63a0e240-460d-45d0-9dca-ef2543e6145c admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:14.103674 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-63a0e240-460d-45d0-9dca-ef2543e6145c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012534 Sep 12 14:08:14.104183 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Sep 12 14:08:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:08:14.115389 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-526a9eee-02ac-4a56-8c0c-65838e6a814c admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:14.122592 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-526a9eee-02ac-4a56-8c0c-65838e6a814c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010774 Sep 12 14:08:14.123155 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Sep 12 14:08:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:08:14.134401 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:14.141342 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010899 Sep 12 14:08:14.141844 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Sep 12 14:08:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:08:14.153197 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-1b96b041-1396-4a02-ab10-67587f7adfd4 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:08:14.160189 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-1b96b041-1396-4a02-ab10-67587f7adfd4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010462 Sep 12 14:08:14.160717 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Sep 12 14:08:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:11:13.189373 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:13.190384 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 12 14:11:13.190779 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:11:13.331303 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=6 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:13.496400 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:13.501058 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:13.501537 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:13.501963 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:13.503413 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:13.503949 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:13.504454 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:13.536764 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-5a89c344-3428-49d2-8c0c-baad94f6b411 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.206621 Sep 12 14:11:13.537327 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:11:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:11:14.615827 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:14.616833 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 12 14:11:14.617233 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:11:14.805735 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:14.809155 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:14.809614 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:14.810061 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:14.810784 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:14.811250 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:14.811657 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:14.833314 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-6f284e97-5812-4cff-86d4-e21327c12f4a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077928 Sep 12 14:11:14.833799 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:11:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:11:26.309741 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:26.310738 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 12 14:11:26.311186 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:11:26.452690 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:26.453392 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:26.453989 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=8 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:11:26.501470 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:26.504892 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:26.505378 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:26.506448 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:26.507235 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:26.507700 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:26.508129 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:26.532793 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d9629994-eef4-4c1e-ac95-5caa34966479 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.084522 Sep 12 14:11:26.533275 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:11:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:11:27.609110 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:27.610126 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-20159981-c4f1-479e-9eff-bafbebc9c233 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 12 14:11:27.610525 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 12 14:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:11:27.798759 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:11:27.802651 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:27.803169 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:27.803593 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:27.804291 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:11:27.804727 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:11:27.805163 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:11:27.827268 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ebdb6ff5-1bb1-4ca9-b3ba-db8292106965 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.078399 Sep 12 14:11:27.827743 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 12 14:11:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:12:26.634358 dv-cinder-820027-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 12 14:12:26.634895 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: Mon Sep 12 14:12:26 2022 - graceful shutdown triggered... Sep 12 14:12:26.635315 dv-cinder-820027-25-iscsi devstack@n-api.service[105611]: Gracefully killing worker 1 (pid: 105611)... Sep 12 14:12:26.635674 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: Gracefully killing worker 2 (pid: 105612)... Sep 12 14:12:26.759995 dv-cinder-820027-25-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=4 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:12:27.634976 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: worker 1 buried after 1 seconds Sep 12 14:12:27.635529 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: worker 2 buried after 1 seconds Sep 12 14:12:27.635529 dv-cinder-820027-25-iscsi devstack@n-api.service[105610]: goodbye to uWSGI. Sep 12 14:12:27.636482 dv-cinder-820027-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 12 14:12:27.637029 dv-cinder-820027-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 12 14:12:27.639877 dv-cinder-820027-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 14:12:27.652175 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 14:12:27 2022] *** Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: nodename: dv-cinder-820027-25-iscsi Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: machine: x86_64 Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: clock source: unix Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: pcre jit disabled Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: detected number of CPU cores: 4 Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: current working directory: / Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: detected binary path: /usr/bin/uwsgi-core Sep 12 14:12:27.654142 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: your processes number limit is 47680 Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: your memory page size is 4096 bytes Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: detected max file descriptor number: 2048 Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: lock engine: pthread robust mutexes Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: thunder lock: enabled Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 14:12:27.655123 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 14:12:27.700109 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: Python main interpreter initialized at 0x55ebb2da99c0 Sep 12 14:12:27.700109 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: python threads support enabled Sep 12 14:12:27.700109 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: your server socket listen backlog is limited to 100 connections Sep 12 14:12:27.700109 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: your mercy for graceful operations on workers is 90 seconds Sep 12 14:12:27.700521 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 14:12:27.700596 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: *** Operational MODE: preforking *** Sep 12 14:12:27.700931 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: *** uWSGI is running in multiple interpreter mode *** Sep 12 14:12:27.700931 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: spawned uWSGI master process (pid: 120586) Sep 12 14:12:27.701066 dv-cinder-820027-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 14:12:27.703867 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: spawned uWSGI worker 1 (pid: 120624, cores: 1) Sep 12 14:12:27.704437 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: spawned uWSGI worker 2 (pid: 120625, cores: 1) Sep 12 14:12:27.704738 dv-cinder-820027-25-iscsi devstack@n-api.service[120586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 14:12:28.385707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 14:12:28.391812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 14:12:29.544886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:12:29.544886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: from cryptography.utils import int_from_bytes Sep 12 14:12:29.545586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:12:29.545586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: from cryptography.utils import int_from_bytes Sep 12 14:12:29.547927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:12:29.547927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Sep 12 14:12:29.548399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 14:12:29.548399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Sep 12 14:12:31.952940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 14:12:31.953539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 14:12:31.953812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 14:12:31.954100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 14:12:31.954353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 14:12:31.954744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.955096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.955414 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.955730 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.956058 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.956365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.956686 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.957569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.957894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.958165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.958468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.958980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-25-iscsi {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.959306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.959618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.959929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.960247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.960552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.960874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.961178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.961685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.963985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.964303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.964612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.964927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.965333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-25-iscsi {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.965641 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.965955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.966288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.966693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.967042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.967352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.967676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.967978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.968288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.968599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.968920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.969223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.969539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.969860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.970159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.970471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.970764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.971094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.971410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.971642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.971948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.972266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.972621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.972944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.973195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.973443 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.973757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.974074 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.974379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.974687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.975014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.975319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.975622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.975728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 14:12:31.976163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.976410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 14:12:31.976575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.976752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 14:12:31.976912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.977087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 14:12:31.977238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.977393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 14:12:31.977546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.977546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.977915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978443 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.978949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.979252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.979419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.979621 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.979828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980678 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.980990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.981164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.981376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.981582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.981582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.981874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-25-iscsi {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.982868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.983030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.983030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.983361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.983529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.983708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.984554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.984739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.984905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985497 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.985986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.986213 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.986419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.986706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.986891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987342 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.987811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988543 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.988846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989144 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-25-iscsi {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.989930 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990234 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.990885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.991920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.992887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.993042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:31.993187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.000996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001166 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.001997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002448 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.002967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.003140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.003327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.003488 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.003633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.004324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.004483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.004713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.004868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005475 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.005953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006099 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006245 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.006918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.007079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.007268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.007578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.007808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.007959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.008133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.008367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.008530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.008698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.008848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.008993 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.009148 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.009481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.009712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.009874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.010104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.010262 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.010420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.010420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.010704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.011076 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.011231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.011387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.011548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.011709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.011855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.012007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.012007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.012290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.012435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.012605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.012758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.012911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.013064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.013219 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.013365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.013525 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.013671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.013822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.013967 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.014118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.014271 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.014425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.014627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.014827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.015018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.015172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.015328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.015481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.015635 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.015789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.015942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.016095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.016250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.016404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.016569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.016727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.016727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.017009 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.017165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.017363 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.017612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.017854 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.018010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.018167 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.018493 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.018688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.018874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.019053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.019235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.020290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.020457 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.020649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.020847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.021227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.021399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.021577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.021731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.024093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.024282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.024439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.024601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.024759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.024913 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.025061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.025206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.025357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.025510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.025674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.025830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.025985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.026132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.026277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.026433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.026599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.026754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.026968 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.027128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.027281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.027481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.027659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.027914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.028146 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.028312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.028487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.028720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.028879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.029039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.029196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.029351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.029510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.029758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.029908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.030062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.030450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.030612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.030769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.030951 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.031098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.031451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.031613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.031613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.031912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.031912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.031912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.032323 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.032480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.032640 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.032794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.032939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.033091 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.033243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.033409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.033409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.033720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.033913 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.034073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.034224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.034368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.034368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.034668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.034820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.035040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.035188 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.035345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.035507 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.035652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.035805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.035950 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.036094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.036316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.036473 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.036628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.036779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.036932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.037095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.037095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.037599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 14:12:32.037771 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.038006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.038174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.038389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.038549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.038722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039159 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039316 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.039476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.040003 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.040153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.040326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.040703 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.040860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.041966 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.042895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043824 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.043970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044433 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.044911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045055 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.045893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.046807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.047980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.048227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.048406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.048651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.048808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.055611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.055801 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.055981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.056951 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.057961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.058111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.058364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.058532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.058781 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.058979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059133 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059294 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.059949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.060210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.060393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.060557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.060722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.060874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061502 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.061987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062138 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.062986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.063148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.063300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.063450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.063600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.063868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.064119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.064278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.065905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.066101 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.066304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.067012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.067181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.067334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.068153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.068336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.068580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.068769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.069005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.069170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.069764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.070271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.070441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.070555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.070664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.070792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.071360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.071531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.077368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.078767 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.078980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.079923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.080843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.081933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.082908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083179 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.083981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084774 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.084982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085064 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085236 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085421 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085680 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085888 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.085986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086434 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086616 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.086797 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087579 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.087975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088686 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.088932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089199 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089616 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089796 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.089958 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090477 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.090946 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091125 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091888 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.091975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.092928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.093977 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094237 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.094940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095890 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.095968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096129 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096211 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096292 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.096962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097638 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097730 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.097910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.098985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099267 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099438 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.099948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.100941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101022 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101110 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101626 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.101962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102491 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102748 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.102912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103381 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103773 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.103946 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104632 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.104945 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105351 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105351 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105654 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.105947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106431 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106648 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.106934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107242 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107477 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107796 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107864 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.107942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108774 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.108927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109910 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.109978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110056 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110209 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110280 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110529 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.110927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111583 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.111965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112033 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112495 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.112933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113629 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.113980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.114777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115892 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.115969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116344 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116772 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116911 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.116978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117269 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117363 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117812 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.117985 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118159 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.118960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119234 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119642 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119878 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.119977 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120069 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.120986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121070 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121871 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.121964 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.122186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.122283 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.122549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.122649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.122880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123017 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.123933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.124868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125171 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125705 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.125802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126414 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126629 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.126972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127068 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127374 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.127903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.128000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.128225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.128316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.128514 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.128610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.129379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.129483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.129736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.129840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130002 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.130965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.131982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.132929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.133875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.134793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.135793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136347 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136438 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.136961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.137972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138485 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.138962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.139940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140798 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.140906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.141808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142173 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.142742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143729 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.143954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144283 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144607 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.144915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145259 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.145872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.146102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.146193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.146416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.146734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.146870 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147161 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147497 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.147821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148035 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.148960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149588 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.149906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.150917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151671 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151886 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.151977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.152918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.153866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154079 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.154853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155037 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.155949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156049 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156265 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.156894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157037 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157525 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.157951 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.158932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.159126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.159323 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.159474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.159638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.159786 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.160971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.161981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162291 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.162942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.163985 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164801 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.164936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.165998 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166110 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166716 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.166971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167370 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.167999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168613 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.168932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.169849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170071 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.170826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171121 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.171953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172571 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.172976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.173180 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.173280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.173486 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.173727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.173820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.174787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.175027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.175129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.175345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.175438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176202 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176514 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176828 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.176959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177456 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.177931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.178899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179555 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.179852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.180105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.180206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.180439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.180683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.180783 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.181978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.182936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.183974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184184 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184495 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.184914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.185841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186049 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186667 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.186906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.187983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188854 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.188944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189171 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189614 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.189882 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.190353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.190461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.190659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.190773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.190989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.191173 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.191911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192313 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.192900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.193995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.194191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.194320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.194502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.194651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.194829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195200 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.195991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.196962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197561 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.197860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198009 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198147 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198430 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.198903 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199377 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.199822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200016 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200625 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.200927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201232 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.201938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202545 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.202881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.203791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204101 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204445 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.204930 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205023 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205892 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.205990 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.206980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207615 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.207934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.208156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.208375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.208475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.208710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.208811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209781 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.209995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.210943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.211979 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.212900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213210 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213567 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.213831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.214990 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.215926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.216021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.216238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.216330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.217800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.217934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218209 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218300 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218300 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218464 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.218964 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219247 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.219996 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.220866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 14:12:32.220987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.221238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.221559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.221881 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.222196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.222543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.222873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.223208 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.223548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.223877 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.224206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.224514 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.224821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.225126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.225436 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.225754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.226061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.226365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.226667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.227000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.227304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.227608 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.227912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.228211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.228518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.228818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.229119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.229419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.229721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.230022 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.230321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.230627 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.230958 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.231264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.231568 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.231869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.232170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.232501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.232834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.233152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.233475 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.233790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.234111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.234422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.234743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.235089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.235406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.235719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.236053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.236363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.236677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.236995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.237302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.237613 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.237923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.238767 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.239134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.239422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.239746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.240068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.240389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.240706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.241020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.241347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.241659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.241971 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.242282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.242595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.242929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.243248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.243561 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.243872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.244189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.244505 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.244830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.245156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.245466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.245791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.246117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.246461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.246774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.247144 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.247475 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.247792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.248106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.248408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 14:12:32.248652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 14:12:32.283174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Registered counter for database nova_api Sep 12 14:12:32.303808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.310380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.310500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Registered counter for database nova_api Sep 12 14:12:32.331019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.337499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.368006 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.context [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294b7baa-bea0-4a69-9ea0-7bb098aa05ae(cell1) {{(pid=120624) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 14:12:32.372054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:12:32.372529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:12:32.374080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:12:32.374818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:12:32.375293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:12:32.377293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:12:32.379861 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Registered counter for database nova_cell0 Sep 12 14:12:32.383882 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Registered counter for database nova_cell1 Sep 12 14:12:32.391332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.393310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.395152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.context [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),294b7baa-bea0-4a69-9ea0-7bb098aa05ae(cell1) {{(pid=120625) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 14:12:32.399217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:12:32.399454 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.399695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:12:32.401255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:12:32.401563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.401988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:12:32.402434 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:12:32.404477 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:12:32.406480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Registered counter for database nova_cell0 Sep 12 14:12:32.411092 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Registered counter for database nova_cell1 Sep 12 14:12:32.418170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.419867 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.426326 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.428361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.551899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO dbcounter [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Registered counter for database nova_cell0 Sep 12 14:12:32.559194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_db.sqlalchemy.engines [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.564026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writer thread running {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.577302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Registered counter for database nova_cell0 Sep 12 14:12:32.583830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 14:12:32.588225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 14:12:32.886776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:12:32.894116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:12:32.908019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:12:32.915945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:12:33.256893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:12:33.264514 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: WARNING keystonemiddleware.auth_token [None req-02b5a624-3ac3-4da0-99e8-8824d6db2840 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:12:33.270479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 14:12:33.270959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebb2da99c0 pid: 120624 (default app) Sep 12 14:12:33.276476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-ebdc2948-5ad4-4284-af82-4fbfd8faa7ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 14:12:33.281805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebb2da99c0 pid: 120625 (default app) Sep 12 14:13:08.585729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:08.586529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:08.587301 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:08.588253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:10.095313 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a9a3cf20-7df0-4d52-9e3c-f5c2b1407e9a tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Action: 'create', calling method: .version_select at 0x7f75619fa4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-48364071", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:11.590600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a9a3cf20-7df0-4d52-9e3c-f5c2b1407e9a tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.018597 Sep 12 14:13:11.614702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 12 14:13:08 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3044 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 14:13:11.989058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d08de6c4-fae9-49d5-aaaa-9324443be4bb tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Calling method '.version_select at 0x7f7561aa9f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:12.032011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:12.032818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:12.034228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:12.043112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:12.802609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d08de6c4-fae9-49d5-aaaa-9324443be4bb tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b" status: 200 len: 352 microversion: 2.1 time: 1.186188 Sep 12 14:13:12.803294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:11 2022] GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b => generated 352 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:13:12.825643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4dc1d1d4-b914-4df2-868c-a65da14ac249 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Calling method '.version_select at 0x7f75618cc3a0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:12.906468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4dc1d1d4-b914-4df2-868c-a65da14ac249 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b" status: 200 len: 352 microversion: 2.1 time: 0.093451 Sep 12 14:13:12.917829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:12 2022] GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:12.923550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29d60a44-addd-402a-a374-697b4fedadcb tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Calling method '.version_select at 0x7f75618bc3a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:13.029498 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29d60a44-addd-402a-a374-697b4fedadcb tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b" status: 202 len: 0 microversion: 2.1 time: 0.108165 Sep 12 14:13:13.033727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:13:12 2022] DELETE /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:13:13.038575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b8982308-3b22-43f1-96f3-29f3bdd8b0da tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Calling method '.version_select at 0x7f75618cca60>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:13.089900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b8982308-3b22-43f1-96f3-29f3bdd8b0da tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b" status: 200 len: 351 microversion: 2.1 time: 0.055088 Sep 12 14:13:13.090684 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:13 2022] GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:14.104714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70349445-c3a2-49c5-aab5-1009a3a36ac9 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Calling method '.version_select at 0x7f75618bc550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:14.184941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-70349445-c3a2-49c5-aab5-1009a3a36ac9 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] HTTP exception thrown: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70349445-c3a2-49c5-aab5-1009a3a36ac9 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Request method failure captured: Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b HTTP/1.1 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz50nxRZAavgvFthwUU6Wqfz_t4fTl9S0vTbVf95i8gNqT4jswtnarFv6pG6TVdW_HK-0fimf6fZpmRRo_9-VerqWk5Q5QfYDnJ4CBXwVTqTHSIQazaBCuYjScSy8iCqpXY3MahzDHQvyaWt37CdQ0C5MK2e3zlxuviO98q_8U61fZE Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: cc1e89bb0f744de5b1c520d488ae1b25 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesGetTestJSON-1632833837 Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:13:14.190096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1e89bb0f744de5b1c520d488ae1b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cc1e89bb0f744de5b1c520d488ae1b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cc1e89bb0f744de5b1c520d488ae1b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cc1e89bb0f744de5b1c520d488ae1b25", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesGetTestJSON-1632833837 Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: cc1e89bb0f744de5b1c520d488ae1b25 Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesGetTestJSON-1632833837 Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesGetTestJSON-1632833837-project Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: de2460c2fdb04a949046acd6a3c0abaa Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesGetTestJSON-1632833837-project Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '2ea144ea-fb05-4825-8de0-a7c397ed723b'} Sep 12 14:13:14.191440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. (HTTP 404) (Request-ID: req-da6f5713-d471-4bb8-9146-1fbd4700c4d1) Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:14.192082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:13:14.192903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 14:13:14.193731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. Sep 12 14:13:14.194562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:14.197076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70349445-c3a2-49c5-aab5-1009a3a36ac9 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] Returning 404 to user: Volume 2ea144ea-fb05-4825-8de0-a7c397ed723b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:14.198196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70349445-c3a2-49c5-aab5-1009a3a36ac9 tempest-VolumesGetTestJSON-1632833837 tempest-VolumesGetTestJSON-1632833837-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b" status: 404 len: 109 microversion: 2.1 time: 0.097325 Sep 12 14:13:14.202689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:14 2022] GET /compute/v2.1/os-volumes/2ea144ea-fb05-4825-8de0-a7c397ed723b => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:13:21.561240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-23df9234-fb71-4133-9c9b-71c0d2702575 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f7561866160>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:21.643290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-23df9234-fb71-4133-9c9b-71c0d2702575 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c60da10e-7297-400a-b8b0-ed5eed36f0d9" status: 200 len: 350 microversion: 2.1 time: 0.096468 Sep 12 14:13:21.648673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:21 2022] GET /compute/v2.1/os-volumes/c60da10e-7297-400a-b8b0-ed5eed36f0d9 => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:22.664131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e0f9afb-0363-45d7-80dc-b7db34da41d7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: .version_select at 0x7f7562229af0>, body: {"keypair": {"name": "tempest-keypair-2101970077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxM96Kq/g5mv700hu5zzEi5sX4Q3v7LKHKBGkSzOYKgsIBO/uz+8gmW4TnO6m4Pa/FGKlmgThLAwf/uaUnv/8tZWolwrlUBKy5pnz+nnbqoi1mbtvvKrb4xDT7hKpStgw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:22.807177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-1e0f9afb-0363-45d7-80dc-b7db34da41d7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for project 613c135e354b4262865198bd5c834cb1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:22.814199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-1e0f9afb-0363-45d7-80dc-b7db34da41d7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for user e7cb679ed52e42ca83a2084f1ad4bd92 and project 613c135e354b4262865198bd5c834cb1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:22.920554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e0f9afb-0363-45d7-80dc-b7db34da41d7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.658815 Sep 12 14:13:22.934536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 4/8] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:13:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:23.541337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6848779-8fb5-4ce1-9fc0-71b8a5925413 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75618ccd30>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:23.708988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6848779-8fb5-4ce1-9fc0-71b8a5925413 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f18c5d23-01a2-466a-8518-6a6be3ea020c" status: 200 len: 350 microversion: 2.1 time: 0.173128 Sep 12 14:13:23.709504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:23 2022] GET /compute/v2.1/os-volumes/f18c5d23-01a2-466a-8518-6a6be3ea020c => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:25.644959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2151889f-754b-49dc-ab63-5eebf67cef55 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f756181d8b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:25.720027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2151889f-754b-49dc-ab63-5eebf67cef55 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aaf2084b-cf6e-4c9b-9c40-d9103a96ac31" status: 200 len: 351 microversion: 2.1 time: 0.084114 Sep 12 14:13:25.721135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:25 2022] GET /compute/v2.1/os-volumes/aaf2084b-cf6e-4c9b-9c40-d9103a96ac31 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:25.734220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1370f69f-b8b5-4afa-8397-3fe7fec80235 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75618cc670>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:25.884151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1370f69f-b8b5-4afa-8397-3fe7fec80235 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.153637 Sep 12 14:13:25.884737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Sep 12 14:13:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:25.901750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bce0913-4136-400d-b057-c3ab70408e83 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f756181dee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:26.054231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2bce0913-4136-400d-b057-c3ab70408e83 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157018 Sep 12 14:13:26.055062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1149 bytes} [Mon Sep 12 14:13:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:26.074312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7aa8f991-761a-46d8-a1c3-05276e62d86b tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f7561866ca0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:26.246287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7aa8f991-761a-46d8-a1c3-05276e62d86b tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.179984 Sep 12 14:13:26.247867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Sep 12 14:13:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:13:26.260692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6f3560f-6aec-4ced-b0c9-074c9a6d6d5e tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f756181ddc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:26.492699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6f3560f-6aec-4ced-b0c9-074c9a6d6d5e tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.235882 Sep 12 14:13:26.510402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1167 bytes} [Mon Sep 12 14:13:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:26.511122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-79decf05-18d4-483b-b8ed-5cb7f0ca8b65 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75618cc550>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:26.661548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-79decf05-18d4-483b-b8ed-5cb7f0ca8b65 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155651 Sep 12 14:13:26.671254 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1170 bytes} [Mon Sep 12 14:13:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:26.678210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5b5b420-db2c-4913-b3bd-50541a65facd tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75617c8700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:26.869807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5b5b420-db2c-4913-b3bd-50541a65facd tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195683 Sep 12 14:13:26.874346 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Sep 12 14:13:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:26.886627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc4fe611-b086-4271-8b53-c94f4f76cb39 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75618660d0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:27.005010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cc4fe611-b086-4271-8b53-c94f4f76cb39 tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122006 Sep 12 14:13:27.006106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1188 bytes} [Mon Sep 12 14:13:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:27.019759 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a90f987-396c-47d4-8be1-50be06bcf1ee tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] Calling method '.version_select at 0x7f75617c8280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:27.116195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a90f987-396c-47d4-8be1-50be06bcf1ee tempest-VolumesTestJSON-1294456667 tempest-VolumesTestJSON-1294456667-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100106 Sep 12 14:13:27.117256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Sep 12 14:13:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:27.410915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1813252882", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187dae32-ddb7-498c-baaa-a0f8b012a4b7"}], "security_groups": [{"name": "tempest-securitygroup--1445208825"}], "key_name": "tempest-keypair-2101970077", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:27.835463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] validate_networks() for [('187dae32-ddb7-498c-baaa-a0f8b012a4b7', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:28.143153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1482608882", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:28.333680 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] validate_networks() for [('83e51b0e-db79-49cd-8380-4c9b5dcda3fe', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:30.107814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:30.108306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:30.108837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:30.109321 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:30.109801 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:30.144598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:30.145613 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:30.146258 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:30.146673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:30.147120 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:30.154605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:30.155121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:30.155605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:30.163081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:30.163869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:30.164449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:30.165560 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:30.165797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:30.166559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:30.167107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:30.167329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:30.169522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:30.201090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:30.206032 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for project 613c135e354b4262865198bd5c834cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:30.207737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for user 5f2ff5e497b64e49b7ac25a941a06048 and project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:30.223255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for user e7cb679ed52e42ca83a2084f1ad4bd92 and project 613c135e354b4262865198bd5c834cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:30.226186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:30.237123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:30.238437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:30.241378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:30.335394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7c42bc9-5a48-44cd-8b53-cd32e7ef41ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.290775 Sep 12 14:13:30.336681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 10/19] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:13:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 14:13:30.383079 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a90cde8e-e134-4dbd-afa7-9b7e73225ded tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.977648 Sep 12 14:13:30.389341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:13:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:13:30.528811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5cfbc24f-5d7e-4606-a91b-8be3c92862bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: .version_select at 0x7f75616eb670>, body: {"keypair": {"name": "tempest-keypair-525560368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC5DsfPeHdB57Z94bV6OjuKO+rKWZGYIlqFmjz9I9SVmNQvC9+8fYc2krz+6vmBfn5yY0HYvQpu94IOll+DT+lJ1+t62OBUeEVsCNCYUgOt7A0t/4lG7uFIFcAtOcHsUg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:30.569975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6c8ff5c5-0665-4c4c-bf68-73064429e794 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: .version_select at 0x7f7560f75c10>, body: {"keypair": {"name": "tempest-keypair-1660550540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0elwZSWNHNq7eliBHGv+lTOZNQcdeNE0IU3YbY3vsN5Y8Yn56ZzPhq06eLDmJy5A3NfYM6upgQlpGCLkdUMsyPut2UKcWdEOOeq/fLPmzkuDBDsaG0XaQkkAeybaasXw=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:30.581964 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-5cfbc24f-5d7e-4606-a91b-8be3c92862bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:30.587784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-5cfbc24f-5d7e-4606-a91b-8be3c92862bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for user 0cafcc70e0e74a5fa7c5ce530e0e848f and project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:30.618199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5cfbc24f-5d7e-4606-a91b-8be3c92862bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.279203 Sep 12 14:13:30.619792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 11/21] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Sep 12 14:13:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 14:13:30.637424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-6c8ff5c5-0665-4c4c-bf68-73064429e794 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:30.642929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-6c8ff5c5-0665-4c4c-bf68-73064429e794 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:30.710820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6c8ff5c5-0665-4c4c-bf68-73064429e794 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.319394 Sep 12 14:13:30.711361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 11/22] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:13:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:30.728792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10d5a31b-f063-4c8d-b4eb-13bfb7e47376 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:30.731042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-10d5a31b-f063-4c8d-b4eb-13bfb7e47376 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:30.809037 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-520918166", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "networks": [{"uuid": "b78d8415-a575-41b2-ab84-45a675817a3d"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:30.936368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-10d5a31b-f063-4c8d-b4eb-13bfb7e47376 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:30.941244 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] validate_networks() for [('b78d8415-a575-41b2-ab84-45a675817a3d', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:30.983244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-10d5a31b-f063-4c8d-b4eb-13bfb7e47376 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1222 microversion: 2.1 time: 0.261057 Sep 12 14:13:30.984524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:30 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:31.001638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-aa6493e5-4088-4534-9347-a8814b731f26 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:31.002476 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-aa6493e5-4088-4534-9347-a8814b731f26 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:31.355082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-aa6493e5-4088-4534-9347-a8814b731f26 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:31.366066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-aa6493e5-4088-4534-9347-a8814b731f26 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1238 microversion: 2.1 time: 0.380250 Sep 12 14:13:31.375122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:30 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1238 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:31.385075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1356685173", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:31.569281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] validate_networks() for [('83e51b0e-db79-49cd-8380-4c9b5dcda3fe', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:33.033640 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:33.034135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:33.034817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:33.035347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:33.035977 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:33.056433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:33.059018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:33.059568 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:33.075156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:33.076455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:33.078815 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:33.143065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Getting quotas for project e73505faee9c4bacbf2456e2d69c56f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:33.172997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Getting quotas for user 1c6cd05ddb3d4d14b2a18bc45401e73d and project e73505faee9c4bacbf2456e2d69c56f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:33.231760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:33.246949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:33.543142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c92b9c77-c936-46fb-b951-a4e94e99d817 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.922079 Sep 12 14:13:33.552205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 12/25] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:13:33.577433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d47fe4a8-2b18-40a7-a714-210150f9cc09 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:33.578059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d47fe4a8-2b18-40a7-a714-210150f9cc09 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:33.880067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d47fe4a8-2b18-40a7-a714-210150f9cc09 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:33.920575 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d47fe4a8-2b18-40a7-a714-210150f9cc09 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1238 microversion: 2.1 time: 0.366731 Sep 12 14:13:33.940252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:33 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1238 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:33.953552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0b3dae7-3681-492b-a051-a3395bf5ff43 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:33.954620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0b3dae7-3681-492b-a051-a3395bf5ff43 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:33.983151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:33.984195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:33.986780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:33.987773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:33.988637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:34.011029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:34.011685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:34.014399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:34.016162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:34.019536 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:34.022500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:34.080318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:34.092241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for user 5f2ff5e497b64e49b7ac25a941a06048 and project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:34.131668 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:34.143858 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0b3dae7-3681-492b-a051-a3395bf5ff43 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:34.161512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0b3dae7-3681-492b-a051-a3395bf5ff43 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1214 microversion: 2.1 time: 0.219587 Sep 12 14:13:34.163228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:34.186478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:33 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:34.320015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0cdc7405-102c-4bde-a760-47966d5d97f5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.936791 Sep 12 14:13:34.323953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 14/28] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:13:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:13:34.335868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c37206ec-7130-42c8-bbc2-91236997df68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:34.336559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c37206ec-7130-42c8-bbc2-91236997df68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:34.453822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c37206ec-7130-42c8-bbc2-91236997df68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:34.463429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c37206ec-7130-42c8-bbc2-91236997df68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1222 microversion: 2.1 time: 0.131401 Sep 12 14:13:34.480019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:34 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:34.957260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:34.958073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:34.985352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:34.986520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:34.987543 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:34.988880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:34.989506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:34.990318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:35.194755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:35.196308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:35.210733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:35.219836 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:35.221954 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:35.223131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:35.226033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:35.226748 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:35.656817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:35.699161 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f7eab33f-a3aa-412d-b5bc-bfac1bb97d3b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1290 microversion: 2.1 time: 0.747674 Sep 12 14:13:35.702406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 15/30] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:34 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1290 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:35.721608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:35.732090 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:35.757674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:35.761225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:35.761675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:35.767552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:35.770994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:35.772411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:35.825799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:35.876334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de35de25-8cdb-4469-8216-16b40e9e4b61 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1218 microversion: 2.1 time: 0.684022 Sep 12 14:13:35.879139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:35 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1218 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:35.938760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:35.952148 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7c9fd3c9-a012-4b50-93d8-7a38d0ba450c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1218 microversion: 2.1 time: 0.243621 Sep 12 14:13:35.967866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:35 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:36.103145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-137004518", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9236f9c0-b543-4fbe-9872-2a3e0012862d"}], "security_groups": [{"name": "tempest-securitygroup--920233194"}], "key_name": "tempest-keypair-1660550540", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:36.726682 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:36.728827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:36.747509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:36.749702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:36.750143 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:36.752452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:36.752927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:36.755777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:37.025306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:37.036989 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0c321fd5-2eae-49c3-8c1e-f17285a4450b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1296 microversion: 2.1 time: 0.315088 Sep 12 14:13:37.047007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 17/33] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:36 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1296 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:13:37.062768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:37.063419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:37.084784 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:37.096668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] validate_networks() for [('9236f9c0-b543-4fbe-9872-2a3e0012862d', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:37.099630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:37.100248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:37.101413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:37.103950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:37.104400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:37.982516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:37.996163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cb9a38aa-9f08-4eb7-9ee6-caed4e9f52dd tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1274 microversion: 2.1 time: 0.943744 Sep 12 14:13:38.019434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 18/34] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:37 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1274 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:38.043522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:38.049076 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:38.116870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:38.121363 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:38.124592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:38.134645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:38.137186 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:38.138126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:38.948536 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:38.960803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f25eade2-437d-4b98-9256-85d6849b7278 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1282 microversion: 2.1 time: 0.938301 Sep 12 14:13:38.963424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:38 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1282 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:40.058977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-71f0c91e-ca5a-48f2-b1e6-f28188e3642b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Action: 'create', calling method: .version_select at 0x7f7560e2a1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-726577198", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-71f0c91e-ca5a-48f2-b1e6-f28188e3642b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 121 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:13:40.065631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-726577198", "metadata": {"Type": "work"}}} Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: Sep 12 14:13:40.067137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-726577198', 'metadata': {'Type': 'work'}}}} Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise error Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi '#$%' Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:40.068072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 14:13:40.070937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 14:13:40.073428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 14:13:40.073428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:40.075466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-71f0c91e-ca5a-48f2-b1e6-f28188e3642b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:40.076559 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-71f0c91e-ca5a-48f2-b1e6-f28188e3642b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.111969 Sep 12 14:13:40.077365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 20/36] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 12 14:13:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:13:40.087833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1877505602", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96bd5f8d-099c-4d46-b564-f8ab0058d9c3"}], "security_groups": [{"name": "tempest-securitygroup--2032253567"}], "key_name": "tempest-keypair-525560368", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:40.471578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:40.472092 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:40.472450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:40.473028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:40.473576 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:40.490317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:40.490811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:40.491271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:40.491989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:40.492441 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:40.492860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:40.547393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:40.555994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:40.588937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:40.603984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:40.717245 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbb4a2f3-25a0-4a8c-9ebc-53ce2f04a35d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.613325 Sep 12 14:13:40.719966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 17/37] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:13:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 4623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:13:40.749207 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:40.752109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:40.794651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] validate_networks() for [('96bd5f8d-099c-4d46-b564-f8ab0058d9c3', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:13:40.799289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:40.803248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:40.804562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:40.805639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:40.806477 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:40.807081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:41.184704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:41.198143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52dd3e2a-e18f-4779-a8a9-95c970c0a7b3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1296 microversion: 2.1 time: 0.473879 Sep 12 14:13:41.200081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 18/38] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:40 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1296 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:41.246862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:41.249775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:41.275569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:41.276770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:41.278975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:41.281903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:41.283043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:41.285389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:42.879111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:42.899410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c47cb10f-ca30-4212-bf76-8d73de88165c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 1.694949 Sep 12 14:13:42.901156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:41 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:42.918671 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:42.921486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:42.957093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:42.958594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:42.959655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:42.962174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:42.964830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:42.966911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.191713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:43.202695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27f1ec25-1c9a-4ae3-b9da-5ac2b046936e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1280 microversion: 2.1 time: 0.298627 Sep 12 14:13:43.228038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:42 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:43.228713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcc8a8b5-a769-4b68-9e7e-4f132b87f381 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Action: 'create', calling method: .version_select at 0x7f7560e23280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1067421404", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcc8a8b5-a769-4b68-9e7e-4f132b87f381 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 120 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:13:43.234132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1067421404", "metadata": {"Type": "work"}}} Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:13:43.245506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1067421404', 'metadata': {'Type': 'work'}}}} Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '0' Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:43.248604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 14:13:43.253266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 14:13:43.257888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 14:13:43.257888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.257888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcc8a8b5-a769-4b68-9e7e-4f132b87f381 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:43.257888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcc8a8b5-a769-4b68-9e7e-4f132b87f381 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011064 Sep 12 14:13:43.257888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 12 14:13:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:13:43.269837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:43.278850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:43.308772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.310223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.311186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.322465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.324446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.326352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.422037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:13:43.424080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:13:43.425529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:13:43.425529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:13:43.426158 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:13:43.445461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.446807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.447962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.458524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.464532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.465695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.544924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:13:43.569714 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for user 0cafcc70e0e74a5fa7c5ce530e0e848f and project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:13:43.606531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:13:43.609430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:13:43.645458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:43.676662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15df600d-b774-4edd-8e56-327cb61cc8ed tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1293 microversion: 2.1 time: 0.412753 Sep 12 14:13:43.679246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:43 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1293 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:43.706825 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-87c72cc4-1f3c-43d8-851e-29567aeead66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.627990 Sep 12 14:13:43.710067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 21/43] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Sep 12 14:13:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 3632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 14:13:43.715451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3b0a0625-43c5-42de-8bee-1c08f86d466b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Action: 'create', calling method: .version_select at 0x7f7560e2aca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562222933", "metadata": {"Type": "work"}}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3b0a0625-43c5-42de-8bee-1c08f86d466b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 119 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:13:43.729278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562222933", "metadata": {"Type": "work"}}} Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: Sep 12 14:13:43.730466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1562222933', 'metadata': {'Type': 'work'}}}} Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise error Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi '' Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:43.731189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 14:13:43.732258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 14:13:43.733181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 14:13:43.733181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:43.737220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:43.738351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:43.739018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3b0a0625-43c5-42de-8bee-1c08f86d466b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:43.742787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3b0a0625-43c5-42de-8bee-1c08f86d466b tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031212 Sep 12 14:13:43.743881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 12 14:13:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:13:43.756112 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:43.758395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:43.762233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.787345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.788751 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:43.795485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:43.796765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:43.801411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:44.252791 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:44.267899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:44.269355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:44.270479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd5e7a9b-e2e2-4b9b-82dd-d8c27c64ca4d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1281 microversion: 2.20 time: 0.523515 Sep 12 14:13:44.276165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:43 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1281 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:44.288726 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-afd194f5-6b85-42fb-8ab6-3c6f8d2674b9 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Calling method '.version_select at 0x7f7560e7ba60>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:44.348216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-afd194f5-6b85-42fb-8ab6-3c6f8d2674b9 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] HTTP exception thrown: Volume tempest-invalid-1804566567 could not be found. Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-afd194f5-6b85-42fb-8ab6-3c6f8d2674b9 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1804566567 HTTP/1.1 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:13:44.352692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Volume tempest-invalid-1804566567 could not be found. Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'tempest-invalid-1804566567'} Sep 12 14:13:44.353823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1804566567 could not be found. (HTTP 404) (Request-ID: req-06713051-7d29-423a-b7bc-ac6625920534) Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:44.354481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:13:44.355609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1804566567 could not be found. Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:13:44.356737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1804566567 could not be found. Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1804566567 could not be found. Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-afd194f5-6b85-42fb-8ab6-3c6f8d2674b9 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 404 to user: Volume tempest-invalid-1804566567 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-afd194f5-6b85-42fb-8ab6-3c6f8d2674b9 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1804566567" status: 404 len: 99 microversion: 2.1 time: 0.070643 Sep 12 14:13:44.360450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 24/46] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 12 14:13:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1804566567 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 12 14:13:44.363593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:44.365919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:44.384027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:44.387382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:44.387642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:44.388368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:44.388835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:44.390263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:45.104598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:45.115581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7a32e46-063a-4089-801f-396257ed1890 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 1.432602 Sep 12 14:13:45.141224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 23/47] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:43 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:45.154416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:45.156563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:45.167951 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:45.179280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:45.180173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:45.180825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:45.183747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:45.185119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:45.185815 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:45.417160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:45.430425 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8ecee82-5b6b-4963-8e25-d55df51b9556 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 1.074179 Sep 12 14:13:45.431276 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:44 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:45.474229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-17166705-01ad-42e0-a570-a2b54cbc1ed6 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.041323 Sep 12 14:13:45.496125 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 26/49] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Sep 12 14:13:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 14:13:45.510672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:45.511554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:45.529345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:45.529998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:45.533117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:45.536993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:45.537735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:45.538405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:46.460041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:46.475055 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4260300f-16f1-493b-b864-2843373cb3f3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1299 microversion: 2.1 time: 0.977466 Sep 12 14:13:46.475977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:45 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1299 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:46.497982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:46.498595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:46.509298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:46.510736 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:46.511356 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:46.512350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:46.512970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:46.513556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:46.579967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:46.594289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a85fd0d9-2aa8-4154-9a65-6ed432d4b500 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 1.448084 Sep 12 14:13:46.600460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:45 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:46.617176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1043eb2f-dfcb-4bc7-81ed-8e492ce39ca1 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008949 Sep 12 14:13:46.619272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 25/52] 10.222.0.42 () {58 vars in 1137 bytes} [Mon Sep 12 14:13:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 14:13:46.722767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:46.739549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:46.743733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:46.748789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-98bf0806-ccc6-4b7a-a1c6-a542b0cdb0ee tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1333 microversion: 2.20 time: 0.270129 Sep 12 14:13:46.759456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 28/53] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:46 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:46.792116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:46.793557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:46.810899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:46.811563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:46.813647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:46.816954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:46.821089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:46.821796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:47.035690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608616b8-2ef0-4311-83f6-ff44bba4fa27", "tag": "6e135970-815d-473f-83f6-81d3a4e3a6e1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:47.072259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:47.074685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:47.076885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:47.130873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Creating event network-changed:6e135970-815d-473f-83f6-81d3a4e3a6e1 for instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 on hv-cinder-82002 Sep 12 14:13:47.135591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 14:13:47.136824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e48796a7-d204-4477-b788-3abf5dd0a6da req-70fd1365-b2c6-4af8-90be-26b70757cfc7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 14:13:47.148002 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:47.148858 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:47.149696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:47.164740 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:47.166380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:47.170451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:47.211744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.compute.rpcapi [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 14:13:47.215136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] Releasing lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 14:13:47.267288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-579c319f-8914-4a9e-826a-4baa4b932e83 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635473 Sep 12 14:13:47.268281 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 26/54] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:47.273624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:47.274435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:47.289944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:47.291970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:47.293826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:47.294739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:47.300662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:47.301370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.069225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.081102 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e02afbc6-905b-4df9-b3f2-11cb17cdfb3a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 1.320239 Sep 12 14:13:48.090925 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 29/55] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:46 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:48.111708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d75b26d1-511b-4722-a0bc-c9ad465c8798 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Calling method '.version_select at 0x7f7560e4daf0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:48.198994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-d75b26d1-511b-4722-a0bc-c9ad465c8798 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] HTTP exception thrown: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d75b26d1-511b-4722-a0bc-c9ad465c8798 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/os-volumes/87aefeb2-a9ed-443d-8910-0780afc86bfa HTTP/1.1 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:13:48.201251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '87aefeb2-a9ed-443d-8910-0780afc86bfa'} Sep 12 14:13:48.202437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. (HTTP 404) (Request-ID: req-9841568e-a183-4869-a3f7-03268915ef4c) Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:48.203332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:13:48.204379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 14:13:48.206120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d75b26d1-511b-4722-a0bc-c9ad465c8798 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 404 to user: Volume 87aefeb2-a9ed-443d-8910-0780afc86bfa could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d75b26d1-511b-4722-a0bc-c9ad465c8798 tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/87aefeb2-a9ed-443d-8910-0780afc86bfa" status: 404 len: 109 microversion: 2.1 time: 0.110689 Sep 12 14:13:48.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:13:48 2022] DELETE /compute/v2.1/os-volumes/87aefeb2-a9ed-443d-8910-0780afc86bfa => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:13:48.214006 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:48.218132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:48.264744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.265290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.269805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.271348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.272350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.274089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.403161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.413009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12c0befb-78cf-4660-ba44-1d555339ba42 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 1.143455 Sep 12 14:13:48.413606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 27/57] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:47 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:48.418109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:48.446011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:48.468387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.471058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.472256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.477806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.478349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.478783 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.643820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.655966 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-73d3df6d-78b9-4bf9-b1f8-176800d6d1b1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1299 microversion: 2.1 time: 0.449605 Sep 12 14:13:48.659253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 31/58] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:48 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1299 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:48.674535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:48.677649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:48.698222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.700515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.701859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.703508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:48.706011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:48.708292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:48.939809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.958592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.964872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:48.967413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bf2d8012-9d7a-4a84-ba5e-260abbb069e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1339 microversion: 2.20 time: 0.301237 Sep 12 14:13:48.972761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 32/59] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:48 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:48.983420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-67df509e-2a43-47c3-a813-c7332a69213f tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Calling method '.version_select at 0x7f7560dcbca0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:49.042157 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-67df509e-2a43-47c3-a813-c7332a69213f tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] HTTP exception thrown: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-67df509e-2a43-47c3-a813-c7332a69213f tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Request method failure captured: Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/os-volumes/10e11074-53bb-4e53-b97b-7c6069702de8 HTTP/1.1 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6Rg-3qXZIq7AlbcBfLh3fvG4AwKGm8yyHNJJuxvN0Sc0EPZTfyq4Ok49AGo6bUOSG0kMWwIuXfW3Ee5x2qKd4FTGR6Hq1s1vYVHd0_h0jZ6b-mldrUErHqV2yinBal_XI7tcGJYUFFx3dkyDV6_DKtama1GqLNd3HRSlNbQRx3sys Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:13:49.044446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e3af2264bad4107928e28327806d8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e3af2264bad4107928e28327806d8a8", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7e3af2264bad4107928e28327806d8a8 Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesNegativeTest-534548092 Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: a4d1432f4d5349048189f1017199691e Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesNegativeTest-534548092-project Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '10e11074-53bb-4e53-b97b-7c6069702de8'} Sep 12 14:13:49.045887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. (HTTP 404) (Request-ID: req-095e73bc-f736-4a48-b441-e58c4c47d9ae) Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:49.046953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:13:49.048270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 14:13:49.049335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-67df509e-2a43-47c3-a813-c7332a69213f tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] Returning 404 to user: Volume 10e11074-53bb-4e53-b97b-7c6069702de8 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-67df509e-2a43-47c3-a813-c7332a69213f tempest-VolumesNegativeTest-534548092 tempest-VolumesNegativeTest-534548092-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/10e11074-53bb-4e53-b97b-7c6069702de8" status: 404 len: 109 microversion: 2.1 time: 0.071232 Sep 12 14:13:49.050468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 33/60] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:13:48 2022] GET /compute/v2.1/os-volumes/10e11074-53bb-4e53-b97b-7c6069702de8 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:13:49.117885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:49.119289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:49.129349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:49.139508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:49.140295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:49.144813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:49.146401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:49.147319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:49.147924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:49.222723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:49.238384 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c99d896-ec4f-4eee-bc30-b0ad7471f3b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.821983 Sep 12 14:13:49.256088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 28/61] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:48 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:49.321176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d23509-c830-4101-bcd2-9f320baffe8e", "tag": "42101474-6616-44ed-98de-9145d66931c3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:49.373783 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:49.374274 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:49.377040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:49.401969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] Creating event network-changed:42101474-6616-44ed-98de-9145d66931c3 for instance 88d23509-c830-4101-bcd2-9f320baffe8e on hv-cinder-82002 Sep 12 14:13:49.412827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2d192bb2-0bec-4b46-ba17-222d40aed7a9 req-b6f52140-ffc5-45dc-acc3-1d3a9fe1ae4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097318 Sep 12 14:13:49.416924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 29/62] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:13:49.440782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:49.442237 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:49.464320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:49.467946 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:49.472036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:49.477979 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:49.480743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:49.485706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:50.566302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:50.581589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57fee144-9c61-4f73-9f08-ff76c90776ec tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 1.141360 Sep 12 14:13:50.604165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:49 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:13:50.616751 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:50.617547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:50.624691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:50.637746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:50.653908 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:50.654602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:50.655959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:50.657010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:50.657600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:51.286361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:51.314081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e17f90ce-3f2a-4d68-bb28-153c7cfbdd6e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 2.197774 Sep 12 14:13:51.320623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 34/64] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:49 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:13:51.347700 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:51.348506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:51.362335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:51.362851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:51.363308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:51.371376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:51.371860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:51.372305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:51.593654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:51.596833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=83 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:51.606264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:51.607829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:51.609538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8e03cda3-c276-44df-8115-8b0cd7ccb7fc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1339 microversion: 2.20 time: 0.278829 Sep 12 14:13:51.610816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 35/65] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:51 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:51.616339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:51.617099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:51.624955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:51.626107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:51.627071 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:51.627992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:51.628621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:51.629278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:51.942028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:51.962503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-673f67cb-5751-4e13-842a-41fd8f13f80a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 1.355894 Sep 12 14:13:51.978113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:50 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:52.059961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58855138-24d4-43f5-bbf2-c470cb31e738", "tag": "9b4b2dfa-ae8b-4ebb-b407-6236bc862edd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:52.074311 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.078080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.079564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.092895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] Creating event network-changed:9b4b2dfa-ae8b-4ebb-b407-6236bc862edd for instance 58855138-24d4-43f5-bbf2-c470cb31e738 on hv-cinder-82002 Sep 12 14:13:52.099493 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2370040b-0fec-4591-9223-682b39b62494 req-ccc6d118-c44c-4999-9f7c-443dc5b12ab8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133857 Sep 12 14:13:52.100666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 32/67] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:52.107323 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.116876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e5283037-0387-4005-8bba-a83e1ad734a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.504701 Sep 12 14:13:52.118765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:52.120485 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 36/68] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:51 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:52.121112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:52.128251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.129130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.129751 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.130821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.131492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.132097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.346546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:52.352738 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:52.360677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.363156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.363156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.363617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.364520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.365105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.454158 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.457782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=85 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:52.467408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d0757a0-010d-4962-95d1-e62a5327f1d1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.365281 Sep 12 14:13:52.468265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:52 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:52.640659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:52.641524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:52.652628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.653131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.653571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.656456 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.657485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.657923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.862789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.877170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.879761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.881195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce5c4dbf-fea0-4f4b-923f-ae55d4c9f179 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1339 microversion: 2.20 time: 0.245428 Sep 12 14:13:52.889907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:52.892284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 34/70] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:52 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:13:52.899317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb08f5b9-cb33-43b9-a82c-116ad362579f", "tag": "581da079-111d-4f64-ab1a-c5d8a6a8b6a2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:52.909759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0be17be6-e802-4ba6-83da-2ab8f55c1468 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.566687 Sep 12 14:13:52.910973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 37/71] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:52 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:52.917393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:52.917873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:52.918289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:52.932315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] Creating event network-changed:581da079-111d-4f64-ab1a-c5d8a6a8b6a2 for instance bb08f5b9-cb33-43b9-a82c-116ad362579f on hv-cinder-82002 Sep 12 14:13:52.938368 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0954999b-1bf1-4f42-a0f7-e5be9dea7368 req-f90ee1ab-e266-4b54-a7b3-047df0759d3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044650 Sep 12 14:13:52.939260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 35/72] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:52.992331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:52.992946 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:53.000530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.001184 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.001944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.003130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.004718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.005300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.162617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:53.164009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:53.176856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.177345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.177780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.190219 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.190764 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.191252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.323875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:53.344023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2211b426-da79-4749-82c4-6d9437478206 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.353457 Sep 12 14:13:53.345540 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 38/73] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:52 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:53.452467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:53.479687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ff8284b-c590-4a4a-bc9b-27e78ab146ae tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.306870 Sep 12 14:13:53.480493 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 36/74] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:53 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:53.491348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:53.499481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:53.501270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:53.508133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.520585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.521001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.521758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.522231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.522666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.735850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:53.744778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bd7e736e-203f-495f-a6a4-4040cd55a7a7 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.259204 Sep 12 14:13:53.752292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:53 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:13:53.915647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:53.916717 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:53.923130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.923664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.927033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.927033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.927033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.927033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.938702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:53.939875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:53.948020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.948516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.949142 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:53.949849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:53.950304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:53.950926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:54.258073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=28 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:54.474442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:54.496915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:54.498328 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:54.499585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5abbd9f-d920-4976-a913-48767e39b88b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.589470 Sep 12 14:13:54.500161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 37/76] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:53 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:54.510744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb87e92-51b9-4304-9f0b-2e4297d74891", "tag": "a82000b1-9b15-4c48-b984-b96ae2bf4e5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:54.533839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:54.534587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:54.535205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:54.557706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] Creating event network-changed:a82000b1-9b15-4c48-b984-b96ae2bf4e5f for instance cdb87e92-51b9-4304-9f0b-2e4297d74891 on hv-cinder-82002 Sep 12 14:13:54.574516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-22057e5f-7afd-4c77-ab93-d37579998bbd req-220deac4-6ecc-4d99-82c2-791a9600cd0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068751 Sep 12 14:13:54.575967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 38/77] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:54.593877 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:54.596099 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:54.611896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:54.611896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:54.612061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:54.612727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:54.613178 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:54.617961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:54.895001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:54.903347 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-77744080-ef14-4303-a121-52cdd258469d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.971284 Sep 12 14:13:54.903926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 40/78] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:53 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:54.914311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:54.914940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:54.930592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:54.931143 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:54.931573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:54.932265 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:54.934787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:54.935275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:55.364342 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:55.377803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eada689a-5352-4c69-9194-5c4b675b400b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.799426 Sep 12 14:13:55.379412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 39/79] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:54 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:55.391680 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:55.392532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:55.405201 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:55.407066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:55.409445 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:55.410401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:55.411664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:55.414466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:55.784750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:55.793065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-179a5030-f992-44ba-b6a2-8b6a1c5eece5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.884702 Sep 12 14:13:55.793927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:54 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:55.805187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:55.806501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:55.822300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:55.823239 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:55.823809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:55.824621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:55.825352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:55.825888 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.115944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.127839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5270caef-73af-42bc-8e0d-e69275cd174e tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.744438 Sep 12 14:13:56.129503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:55 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:56.135668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:56.136359 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:56.142763 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.143528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.146511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.147794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.148730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.155535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.330134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.342489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.345302 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.347098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8590b3ee-aa9d-48e6-9566-949ef63c227d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.551975 Sep 12 14:13:56.348213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 42/82] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:55 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:56.399969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.402164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:56.405362 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:56.409668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3e10991-bfcf-41ed-b558-1d5bedda08a5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.278090 Sep 12 14:13:56.411140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:56 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:56.412797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.413290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.413723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.414424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.414898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.415554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.738040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:56.758407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-16195d36-174a-43e4-be32-2b6aa3d10b71 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.360507 Sep 12 14:13:56.762339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:56 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:56.817264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:56.817793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:56.833002 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.833659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.834780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.837222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.837885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.839876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.927082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:56.941944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.942650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.943254 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.966199 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Creating event network-changed:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:13:56.966979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 14:13:56.967515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4730416b-aaee-4f52-bf58-3223c2f503db req-be669e76-52be-4f9e-8f1a-8a34ff4d8950 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 14:13:56.968729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.973999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.974729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.976157 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:56.977695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:56.978324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:56.989948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.compute.rpcapi [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 14:13:56.991336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] Releasing lock "compute-rpcapi-router" {{(pid=120624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 14:13:57.044111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e93ef6af-1916-4d75-a2a0-09b65ab38f2c None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126143 Sep 12 14:13:57.044723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 44/85] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:13:57.087595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:57.100294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9caa84c2-2907-4076-a6ae-195031ee9f3a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.287689 Sep 12 14:13:57.100889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:56 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:57.156206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:57.157705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:57.169876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.170525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.171144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.176065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.178681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.179592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.373149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:57.373838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:57.389579 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:13:57.393838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.397866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.400857 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.402033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.402709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.403416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.835249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:57.841575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-21197a96-5496-4b0a-b8f4-4c12cab34610 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.689764 Sep 12 14:13:57.855197 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 45/87] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:57 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:57.872492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:57.873404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:57.883416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.884846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.885287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.885992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.886452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.887107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.947969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:57.964648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:57.966437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:57.968142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-986ba6e8-267a-45c9-82db-5e9d16a42118 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.599089 Sep 12 14:13:57.969876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 43/88] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:57 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:13:57.986999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:57.987672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:57.993965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.994444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.994889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:57.995583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:57.996017 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:57.996438 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.158402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:58.170616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2635b654-bba3-4bb2-b2ef-ffe1a867a157 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.314059 Sep 12 14:13:58.173437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 46/89] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:57 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:58.184853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:58.185629 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:58.198665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:58.199268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:58.204434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.206625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:58.206625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:58.207065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.265506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:58.283195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af40d68e-d13a-43ab-9276-3f641613dcc1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.309169 Sep 12 14:13:58.283887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 44/90] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:57 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:58.487030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608616b8-2ef0-4311-83f6-ff44bba4fa27", "name": "network-vif-plugged", "status": "completed", "tag": "6e135970-815d-473f-83f6-81d3a4e3a6e1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:13:58.506510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:58.511008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:58.511839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.545068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] Creating event network-vif-plugged:6e135970-815d-473f-83f6-81d3a4e3a6e1 for instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 on hv-cinder-82002 Sep 12 14:13:58.561580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4540a547-b954-4cd1-a63a-9f798c34b717 req-d3d86119-21a1-4e79-b5bb-0fca64d6b4df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273485 Sep 12 14:13:58.563823 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 45/91] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:13:58.623969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:58.651507 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-01c781b4-ac1d-444c-930a-f118afb04689 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.474082 Sep 12 14:13:58.653329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 47/92] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:58 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:58.881775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:58.883148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:58.894454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:58.895206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:58.897274 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.898092 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:58.898650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:58.899177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:58.995834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:58.996527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:59.006435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.007190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.008517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.009238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.009696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.010117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.435697 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.445427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.447831 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ae91a03-af7e-4a52-9b4c-67d84ad8be55 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.570686 Sep 12 14:13:59.448407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 46/93] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:58 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:59.457668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:59.458279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:59.461127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.464204 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.466019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.466510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.466974 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.467675 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.467782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e4617998-1b9b-4e96-a0b1-f448ffbf6b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.476785 Sep 12 14:13:59.468129 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.470224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.470946 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 48/94] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:13:58 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:13:59.477579 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:59.479189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:59.497587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.500543 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.501312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.502218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.505699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.506340 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.804948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.814864 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a65e2e87-4ee6-4257-8c77-e45878973d66 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.342499 Sep 12 14:13:59.852284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:13:59.861182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 49/95] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:59 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:59.866546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b143dde-cd6c-4d67-aa40-b37c532baf74 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.411813 Sep 12 14:13:59.868397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 47/96] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:59 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:13:59.870665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:13:59.871603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:13:59.880596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.881352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.882015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:13:59.883006 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:13:59.884198 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:13:59.884584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.037735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:00.049164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-636c1780-5bec-421b-a72b-e9929e3ba087 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.185912 Sep 12 14:14:00.049927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 50/97] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:13:59 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:00.470772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:00.471558 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:00.479262 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.482810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.484221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.486327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.486735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.487359 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.504772 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:00.505699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:00.524707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.525203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.531546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.532632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.533331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.534627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.818254 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:00.835833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:00.843592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:00.844026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:00.849859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d2ea4b24-dd29-4ec2-80ee-0df121ab39eb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.351320 Sep 12 14:14:00.851818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 51/98] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:00 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:00.865947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6ddcd46-726e-4d2c-8598-71eb16f30e62 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1314 microversion: 2.1 time: 0.398898 Sep 12 14:14:00.869522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d23509-c830-4101-bcd2-9f320baffe8e", "name": "network-vif-plugged", "status": "completed", "tag": "42101474-6616-44ed-98de-9145d66931c3"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:00.877490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:00 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:00.895406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:00.895406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:00.900978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.902264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.904314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.904802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.905377 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.905541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.907115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:00.908905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:00.911221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:00.956291 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] Creating event network-vif-plugged:42101474-6616-44ed-98de-9145d66931c3 for instance 88d23509-c830-4101-bcd2-9f320baffe8e on hv-cinder-82002 Sep 12 14:14:00.970680 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e8e8ccae-59d0-4444-98b7-3c56c4bd9ce1 req-ba4b5f48-1186-43e5-9040-0e5c9ff5dabc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116350 Sep 12 14:14:00.974164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 52/100] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:00.986944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:00.987654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:01.010517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.011944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.012489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.013226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.013690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.014118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.051655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:01.155937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:01.164591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e445fd5-3899-46f2-942b-5528b9572b90 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.285973 Sep 12 14:14:01.165340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:00 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:01.169991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:01.170604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:01.177276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.177957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.178563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.179991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.180393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.180820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.244319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:01.254900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ebd9025-071f-465a-9fba-981e256e08cb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.278795 Sep 12 14:14:01.257191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 53/102] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:00 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:01.384224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:01.396670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50ba23c0-9ded-41c2-87d2-66122a8155e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.230238 Sep 12 14:14:01.398016 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 50/103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:01 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:01.885597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:01.886876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:01.895088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:01.895885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:01.916685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.917673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.918595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.919171 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.919774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.920696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.922776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.923260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.924140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:01.929564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:01.932664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:01.937529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.334992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.353902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.354058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.357167 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.359281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-87c9f058-8b8c-4695-9b16-5d62c188bae4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.478247 Sep 12 14:14:02.360433 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 54/104] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:01 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:02.366194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:02.367106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:02.368136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08494dba-6fd9-4039-ae70-14468d9ea0da tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1501 microversion: 2.1 time: 0.477820 Sep 12 14:14:02.369021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 51/105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:01 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1501 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:02.379741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:02.383221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:02.384183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.384887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.387135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.388631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.400158 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.404699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.410588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.412463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.416310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.418853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.421333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.422012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.469765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:02.673710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.688705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6e9e6e60-7736-448f-8e1c-92d8917bcbfe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.321253 Sep 12 14:14:02.689824 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 55/106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:02 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:02.696709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:02.697652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:02.716943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.717643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.718358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.719534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:02.723291 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:02.723889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:02.739920 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.748897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09bbead1-6e6e-4ad0-89d3-09fa045e4008 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.378532 Sep 12 14:14:02.753350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 52/107] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:02 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:02.955544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:02.964960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e6e3250a-f288-4611-bcca-76860cffbffb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.274065 Sep 12 14:14:02.967965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 56/108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:02 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:03.022249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb87e92-51b9-4304-9f0b-2e4297d74891", "name": "network-vif-plugged", "status": "completed", "tag": "a82000b1-9b15-4c48-b984-b96ae2bf4e5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:03.035536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.036083 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.036592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.052849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] Creating event network-vif-plugged:a82000b1-9b15-4c48-b984-b96ae2bf4e5f for instance cdb87e92-51b9-4304-9f0b-2e4297d74891 on hv-cinder-82002 Sep 12 14:14:03.059752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c43a5efd-7774-465d-af2a-957b8c8d17de req-c28f5b14-d205-4ee0-8f79-a90e65a545ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044972 Sep 12 14:14:03.061498 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 53/109] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:14:03.386082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:03.387295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:03.393579 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.394051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.394472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.395175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.395783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.396268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.571439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:03.580787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:03.582345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:03.583482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-651d6ab2-d2dc-4749-96fc-7971320e4900 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.201842 Sep 12 14:14:03.584639 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 57/110] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:03 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:03.715230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:03.716102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:03.723011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.723600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.724105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.724879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.725407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.725903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.781074 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:03.782690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:03.789612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.790576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.791233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.792360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:03.793586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:03.794478 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:03.994742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.006654 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7146e97-7dc5-4f6c-8e9f-4714f8501ce2 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.292972 Sep 12 14:14:04.012225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 54/111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:03 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:04.022083 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:04.022821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:04.036316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.036799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.037705 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.038742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.039464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.040523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.067115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.082278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ccb0e5f1-26b0-442b-a992-404f76cfa250 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.306302 Sep 12 14:14:04.082741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 58/112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:03 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:04.162678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0efb985e-bbb6-4f18-a587-9776d6b636a1"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:04.165472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:04.179817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.182389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.182896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.188166 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.188723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.190534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.272959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.282179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1498fc6c-af82-406c-b1ae-c40945834b51 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1322 microversion: 2.1 time: 0.268718 Sep 12 14:14:04.282766 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:04 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:04.610409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:04.611467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:04.618134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.618622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.619365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.620158 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:04.620891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:04.621473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:04.825247 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.837932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.841292 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:04.843074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97ed828f-a2b3-47ff-9e76-82e249550ae5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.236786 Sep 12 14:14:04.845918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 56/114] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:04 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:14:04.954355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-05a9eecf-61da-4354-9fbe-4d3cc28b7a0c tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "POST /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798887 Sep 12 14:14:04.956535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 59/115] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:14:04 2022] POST /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:14:05.038187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:05.039382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:05.046646 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.047986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.048584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.049284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.049950 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.051016 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.104354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58855138-24d4-43f5-bbf2-c470cb31e738", "name": "network-vif-plugged", "status": "completed", "tag": "9b4b2dfa-ae8b-4ebb-b407-6236bc862edd"}, {"server_uuid": "bb08f5b9-cb33-43b9-a82c-116ad362579f", "name": "network-vif-plugged", "status": "completed", "tag": "581da079-111d-4f64-ab1a-c5d8a6a8b6a2"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:05.119267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.119976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.121569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.138534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Creating event network-vif-plugged:9b4b2dfa-ae8b-4ebb-b407-6236bc862edd for instance 58855138-24d4-43f5-bbf2-c470cb31e738 on hv-cinder-82002 Sep 12 14:14:05.139344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] Creating event network-vif-plugged:581da079-111d-4f64-ab1a-c5d8a6a8b6a2 for instance bb08f5b9-cb33-43b9-a82c-116ad362579f on hv-cinder-82002 Sep 12 14:14:05.146727 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-cd020106-025e-4c25-a1c8-e4e187a2058f req-1aab98f5-5587-485d-bec6-fb722432b40b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049716 Sep 12 14:14:05.150782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 60/116] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:14:05.156858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:05.157866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:05.165536 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.166703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.167550 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.168388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.168990 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.169407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.275611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:05.292146 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e5c405a-61ab-4444-b08c-48c7d314d394 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.257634 Sep 12 14:14:05.295038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:05 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:05.317448 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:05.318100 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:05.324749 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.325473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.325897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.326941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.327790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.329447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.365786 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:05.375546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-55acc2f2-57f2-450a-b5e6-0329f6018a69 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.223149 Sep 12 14:14:05.391660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 61/118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:05 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:05.718453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:05.726464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29d2df9d-fc01-41fd-ab5e-189120489f39 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1514 microversion: 2.1 time: 0.416332 Sep 12 14:14:05.728101 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:05 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:05.754709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:05.756894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:05.763248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.763970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.764660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.766214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.766918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.767350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.794898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'flavor' on Instance uuid cdb87e92-51b9-4304-9f0b-2e4297d74891 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:14:05.870351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:05.871033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:05.884893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.885457 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.885995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.887506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:05.888048 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:05.888662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:05.999357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-84918a4d-54ae-480d-884c-074e1451c27d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891/action" status: 200 len: 32 microversion: 2.1 time: 0.248771 Sep 12 14:14:06.001270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 62/120] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:14:05 2022] POST /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:14:06.015084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:06.016317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:06.026086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.026585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.027091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.027867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.028392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.028715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.280052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.293572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.296420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.303278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.318829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e0a08861-d03d-4a6d-a857-d77074f24da1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.309535 Sep 12 14:14:06.319984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 63/121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:06 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:06.327604 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:06.328499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd003e65-dcc2-4952-93df-361eaedb5081 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.461853 Sep 12 14:14:06.329176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:06.333707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 59/122] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:05 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:14:06.336754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.337477 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.338075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.339473 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.340141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.340732 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.403379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:06.403993 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:06.411047 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.411547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.411981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.412689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:06.413153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:06.413569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:06.588953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.601320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-229da318-728d-4f0d-a899-2ee0be7910f0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.280023 Sep 12 14:14:06.602081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 64/123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:06 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:06.632690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:06.640986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9fe88ff-b6b1-4ebe-80ee-707ff4c160fa tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.241788 Sep 12 14:14:06.641551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 60/124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:06 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:07.161822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "name": "network-vif-plugged", "status": "completed", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:07.167268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:07.173426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.173902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.174330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.185785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] Creating event network-vif-plugged:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:14:07.192156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-82ab8634-16c9-4576-b547-642753baeddb req-7eeacd0e-4ccc-4601-9886-71d2fcf507c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Sep 12 14:14:07.192758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 65/125] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:07.349422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:07.350020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:07.356217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.356688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.357113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.357781 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.358224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.358641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.358946 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:07.360330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:07.366414 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.366918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.367354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.368035 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.368493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.368918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.556990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.561397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.569259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ec8893a-3cec-4a6f-b6c7-3df18c6e1e15 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.223593 Sep 12 14:14:07.570112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 61/126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:07 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:07.582114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.583703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.584906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-38db02f7-3fb8-446e-8b46-e7ca923dac8b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.230195 Sep 12 14:14:07.585538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 66/127] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:07 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:14:07.624513 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:07.625771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:07.631978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.632462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.632890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.633580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.634032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.634449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.663109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:07.663999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:07.677156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.678092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.678788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.679691 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:07.680324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:07.682208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:07.961902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.962368 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:07.968402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c5766603-ddce-4a4a-a2c4-429ad429d624 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1364 microversion: 2.1 time: 0.308939 Sep 12 14:14:07.970293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 67/128] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:07 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:07.971826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5dbd49ee-5a1b-45dd-b3fa-d97a72b8c930 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1366 microversion: 2.1 time: 0.351209 Sep 12 14:14:07.986864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 62/129] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:07 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:08.593327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:08.594551 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:08.600750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:08.601223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:08.601651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:08.602333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:08.602780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:08.603216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:08.607328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:08.611220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:08.611842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:08.617852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:08.618327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:08.619006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:08.619719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:08.620167 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:08.620583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:08.809762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:08.812751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:08.818329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:08.819806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:08.820921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22cfb0d1-4221-49dd-a975-bfa580096fea tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.215482 Sep 12 14:14:08.821109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dba701a8-738d-4f62-8536-741e6134c74d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.231871 Sep 12 14:14:08.821679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 63/130] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:08 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:08.821787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 68/131] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:08 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:08.993503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:08.994114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:08.996196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:08.996871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:09.000299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.000779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.002062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.003040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.003181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.003571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.003976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.004289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.005005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.005722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.006179 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.006963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.198215 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:09.202135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:09.207243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e52b4b50-7dda-4f80-9e02-c0011d757cf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1549 microversion: 2.1 time: 0.217529 Sep 12 14:14:09.207827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 64/132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:08 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:09.210635 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-04f376c1-ba58-43fd-b668-d9d1795cd24c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1556 microversion: 2.1 time: 0.218123 Sep 12 14:14:09.211238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 69/133] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:08 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:09.229497 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:09.229960 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:09.233005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:09.233500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:09.235936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.236417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.236840 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.237507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.237947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.238355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.239245 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.239724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.240203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.240866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.241315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.241737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.344355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fe705015-fec7-4e29-b216-c41e32e427b5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115013 Sep 12 14:14:09.344944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 70/134] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:14:09 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:14:09.365574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2d20eab-a427-4b5f-a508-029644c06c55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139729 Sep 12 14:14:09.366388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 65/135] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:14:09 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:09.846019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:09.846654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:09.847087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:09.847183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:09.852896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.853394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.854231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.854348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.854694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.855095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.855556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.856086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.856199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:09.856508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:09.856936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:09.857492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:10.230024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:10.243418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2fb802fa-a302-4cb1-941e-53bac1392271 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.397707 Sep 12 14:14:10.249858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 71/136] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:09 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:10.258873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:10.268459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:10.270187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:10.271671 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5ddfb0d-5c52-4ac6-b163-12a823e82770 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.429706 Sep 12 14:14:10.272387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 66/137] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:09 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:10.750584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb08f5b9-cb33-43b9-a82c-116ad362579f", "tag": "581da079-111d-4f64-ab1a-c5d8a6a8b6a2"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:10.760169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:10.760643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:10.761066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:10.783013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] Creating event network-changed:581da079-111d-4f64-ab1a-c5d8a6a8b6a2 for instance bb08f5b9-cb33-43b9-a82c-116ad362579f on hv-cinder-82002 Sep 12 14:14:10.790234 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-4bd7b25d-2ec0-4845-a677-4f77eda19655 req-0e398565-8dee-4e85-92dd-22038c2cda99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043714 Sep 12 14:14:10.790881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 72/138] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:10.944741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58855138-24d4-43f5-bbf2-c470cb31e738", "tag": "9b4b2dfa-ae8b-4ebb-b407-6236bc862edd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:10.957446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:10.957942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:10.958494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:10.973272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] Creating event network-changed:9b4b2dfa-ae8b-4ebb-b407-6236bc862edd for instance 58855138-24d4-43f5-bbf2-c470cb31e738 on hv-cinder-82002 Sep 12 14:14:10.979173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-933f3784-baf2-426b-a235-f22ef0decac7 req-8240eb3b-11bb-48f5-8c18-e65cdda86347 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037370 Sep 12 14:14:10.979975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 67/139] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:11.264583 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:11.265940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:11.273600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:11.274271 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:11.274870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:11.275858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:11.276479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:11.277047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:11.300408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:11.302919 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:11.310491 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:11.311018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:11.311441 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:11.313252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:11.313899 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:11.314573 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:11.502037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:11.512787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-75862433-93c4-4b97-b8ba-52731d059508 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.252251 Sep 12 14:14:11.514663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 73/140] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:11 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:11.524548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:11.533474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:11.534937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:11.536047 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-261070fb-a7a3-4912-9cbe-ea8a218d8dfd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.241571 Sep 12 14:14:11.536597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 68/141] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:11 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:12.541527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:12.542728 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:12.554588 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:12.555426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:12.556220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:12.557182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:12.558594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:12.559451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:12.561541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:12.562212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:12.573628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:12.574123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:12.574565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:12.575301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:12.575756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:12.576176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:13.033189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:13.046528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0443e803-66f3-4af1-83fa-bee05a54425c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.513798 Sep 12 14:14:13.047959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 74/142] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:12 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:13.085226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:13.096204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:13.097641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:13.104465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3ba4b05-83e2-4e28-b1cf-3d3674f3891c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.546340 Sep 12 14:14:13.128177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 69/143] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:12 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:14.070735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:14.074122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:14.081430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:14.081874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:14.082220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:14.082977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:14.083384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:14.084016 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:14.131126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:14.131722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:14.140646 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:14.141397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:14.142146 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:14.144488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:14.145140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:14.145772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:14.371908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:14.393548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-311e3825-fd4a-4bdd-8221-d4eaf5ab1cf9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.326570 Sep 12 14:14:14.394139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 75/144] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:14 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:14.426635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:14.428930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:14.439597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:14.441672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:14.443283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94351cfc-40d8-47fc-ad33-26af3bb41516 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1407 microversion: 2.20 time: 0.316315 Sep 12 14:14:14.443916 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 70/145] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:14 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:14:15.417181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:15.417861 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:15.424474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.424955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.425382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.426252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.426704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.427185 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.469303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:15.470044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:15.477279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=91 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:15.483966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.484956 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.485409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.486132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.486584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.487028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.630577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:15.640405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e97c165f-ef91-43da-bad8-23d7e7fb4e6a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.226969 Sep 12 14:14:15.641341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 76/146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:15 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:15.677549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:15.689825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:15.691289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:15.692471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c23770f4-e93b-4173-bf37-8cde56bfdf52 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1598 microversion: 2.20 time: 0.229289 Sep 12 14:14:15.693024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 71/147] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:14:15 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1598 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:14:15.718618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:15.719757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:15.725107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.725582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.726005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.726683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:15.727152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:15.727674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:15.822910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-22d94c37-2774-4a0a-ac5a-11aca4b6e373 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108102 Sep 12 14:14:15.823706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 77/148] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Sep 12 14:14:15 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:14:16.667833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:16.669553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:16.677834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:16.678320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:16.678808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:16.679490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:16.680120 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:16.680547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:17.198308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:17.209598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b43654bc-d856-4ec4-a78d-aa4c249cf4f8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.547803 Sep 12 14:14:17.213811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 72/149] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:16 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:17.573843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:17.588729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:17.589446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:17.590619 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:17.604984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] Creating event network-changed:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:14:17.611258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e1ac0d4e-a257-4ca8-b45f-d01097ccc2f7 req-fe93ca1d-8185-4754-81b4-7b4cef2c7fed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042190 Sep 12 14:14:17.612154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 78/150] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:18.249430 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:18.250150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:18.260754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:18.261297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:18.261728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:18.264254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:18.264749 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:18.265901 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:18.482794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:18.497149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5df72970-7cbc-432d-b7fd-a78b18845925 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.253731 Sep 12 14:14:18.497997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 73/151] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:18 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:19.522259 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:19.523687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:19.526593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=89 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:19.532767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:19.533326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:19.533752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:19.535217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:19.536092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:19.536497 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:19.717922 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:19.728272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f7e67c3d-8add-4924-ac08-170b068a0bdb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.210159 Sep 12 14:14:19.729374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 79/152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:19 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:20.596723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:20.597634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:20.606012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.606745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.607758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:20.609285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.609823 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.610322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:20.638872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:14:20.739482 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01049adb-ff23-429a-9fec-d8e8c86a9377 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "DELETE /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 204 len: 0 microversion: 2.1 time: 0.148489 Sep 12 14:14:20.740067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 74/153] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:14:20 2022] DELETE /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:14:20.748375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:20.750249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:20.757223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:20.757929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:20.758992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.759681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.760506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:20.761407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.762052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.762668 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:20.764169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.764657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.765927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:20.766617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:20.767100 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:20.767522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:21.005102 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:21.017528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-543b39f8-d75f-4b11-a515-518274be59fb tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1553 microversion: 2.1 time: 0.272359 Sep 12 14:14:21.031615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 80/154] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:20 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:21.043209 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:21.065429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47eaaa60-b173-45d1-a955-50f8149a35b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.311704 Sep 12 14:14:21.066339 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 75/155] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:20 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:22.040429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:22.041033 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:22.047802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:22.048279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:22.048711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:22.049387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:22.049834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:22.050253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:22.090305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:22.090953 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:22.098054 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:22.098538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:22.098990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:22.099942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:22.100538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:22.101227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:22.268983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:22.287168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bcc337a2-7ba0-4d8e-8550-378709d903ea tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1553 microversion: 2.1 time: 0.249521 Sep 12 14:14:22.288154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 81/156] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:22 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:22.297798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:22.306228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b3218e7-cea6-4880-9cea-66cce838bbea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.219950 Sep 12 14:14:22.306795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 76/157] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:22 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:23.319241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:23.319851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:23.326136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:23.326867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:23.328538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:23.329517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:23.329741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:23.330347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:23.330820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:23.331434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:23.339400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:23.339400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:23.340215 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:23.343076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:23.343076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:23.343076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:23.548720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:23.559894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:23.561345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-915716e5-2474-4e46-86bc-125025015a09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.235738 Sep 12 14:14:23.562184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 77/158] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:23 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:23.572757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dd8501ca-ab90-4245-ba2c-3e46c7f7306b tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1553 microversion: 2.1 time: 0.257281 Sep 12 14:14:23.574100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 82/159] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:23 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:23.993395 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608616b8-2ef0-4311-83f6-ff44bba4fa27", "name": "network-vif-deleted", "tag": "6e135970-815d-473f-83f6-81d3a4e3a6e1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:24.003652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:24.004126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:24.004546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:24.016408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] Creating event network-vif-deleted:6e135970-815d-473f-83f6-81d3a4e3a6e1 for instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 on hv-cinder-82002 Sep 12 14:14:24.021450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5cb8a865-3dce-4a0f-8960-7a91b1f6d528 req-87fcaa2b-7c55-459e-8121-67fe9adfa2a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031711 Sep 12 14:14:24.022257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 78/160] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:24.588427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:24.589041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:24.598188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:24.599204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:24.601140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:24.601755 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:24.601996 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:24.603534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:24.604188 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:24.604613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:24.606650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:24.607243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:24.607735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:24.609010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:24.609673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:24.610250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:24.708271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:24.743580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-799a7a8d-50b3-4097-987e-fbee4c469f08 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1345 microversion: 2.1 time: 0.149654 Sep 12 14:14:24.753284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:24 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:24.794781 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:24.803985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b57bb127-e25e-4029-b9a6-aef3f94961e4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.219490 Sep 12 14:14:24.804632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:24 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:25.768983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:25.769785 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:25.776190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:25.776755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:25.777187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:25.777873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:25.778345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:25.778791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:25.828029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:25.828634 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:25.841015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:25.841510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:25.842111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:25.843353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:25.843798 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:25.844218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:25.849295 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:25.859901 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcd39395-e7aa-4a33-b2bd-72b66ea44afc tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1345 microversion: 2.1 time: 0.095465 Sep 12 14:14:25.860638 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:25 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:25.976917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:25.985137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1c9f5808-8521-4cd2-b7b4-4e832b3fead2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.162263 Sep 12 14:14:25.985703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:25 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:26.883524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:26.884399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:26.890094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:26.890571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:26.891032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:26.891719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:26.892201 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:26.892619 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:26.959047 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:26.967176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f2fea4cc-d97f-4b08-b4c6-08fe0729ec8d tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1345 microversion: 2.1 time: 0.088015 Sep 12 14:14:26.967753 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:26 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:27.008064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:27.008599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:27.014969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:27.015441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:27.015865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:27.016545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:27.016987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:27.017400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:27.149910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:27.158272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20e66bb9-9dca-4d11-b940-c41471bf80f2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.154164 Sep 12 14:14:27.159033 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 85/166] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:27 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:27.993460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:27.994063 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:28.006693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:28.007444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:28.008154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:28.009833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:28.010300 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:28.010721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:28.047351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:28.047832 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:28.048572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:28.049966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lazy-loading 'fault' on Instance uuid 608616b8-2ef0-4311-83f6-ff44bba4fa27 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:14:28.095333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6cd05ddb3d4d14b2a18bc45401e73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73505faee9c4bacbf2456e2d69c56f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:28.103747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30e12a75-098f-48e1-bdb6-30cf3b260da1 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 200 len: 1350 microversion: 2.1 time: 0.114287 Sep 12 14:14:28.104323 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 82/167] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:27 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:28.181897 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:28.182572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:28.192840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:28.197265 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:28.198893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:28.208718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:28.210275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:28.211621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:28.395675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:28.397822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:28.404942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-85327da3-0c1c-4a67-81e7-0a5cc53095d5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.226940 Sep 12 14:14:28.405834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 86/168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:28 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:29.127842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:29.128389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:29.134257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.134726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.135181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.135855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.136304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.136718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.150668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] HTTP exception thrown: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Request method failure captured: Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 HTTP/1.1 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6JSNba6kzwD3NR3CSS1IKmrdgfbVHtvn_d1Yz-E1Dgo5MZwMG6sXptLUtolVqbIodRRCz5rxMsawZF-EUwv-FXb-7kOzVOHNogqBZVm4hvKZpJ44nfRJYrHvDzw0iUZcNmdjw5lXJjx0UQVmS5fkgkD0RENhicS4YU1fnocP2bkiU Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:14:29.155876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e73505faee9c4bacbf2456e2d69c56f2", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 1c6cd05ddb3d4d14b2a18bc45401e73d Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.157330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '608616b8-2ef0-4311-83f6-ff44bba4fa27'} Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:14:29.158112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.159366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.160580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Returning 404 to user: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:14:29.160580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25944fc1-9532-4a2d-9e88-cb3d403cbc40 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 404 len: 111 microversion: 2.1 time: 0.033279 Sep 12 14:14:29.160580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 83/169] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:29 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:14:29.268195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:29.270478 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:29.276803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.277280 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.277708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.278384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.278853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.279276 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.292353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] HTTP exception thrown: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Request method failure captured: Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27/os-volume_attachments HTTP/1.1 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6JSNba6kzwD3NR3CSS1IKmrdgfbVHtvn_d1Yz-E1Dgo5MZwMG6sXptLUtolVqbIodRRCz5rxMsawZF-EUwv-FXb-7kOzVOHNogqBZVm4hvKZpJ44nfRJYrHvDzw0iUZcNmdjw5lXJjx0UQVmS5fkgkD0RENhicS4YU1fnocP2bkiU Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:14:29.296357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e73505faee9c4bacbf2456e2d69c56f2", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 1c6cd05ddb3d4d14b2a18bc45401e73d Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.297788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'server_id': '608616b8-2ef0-4311-83f6-ff44bba4fa27'} Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:14:29.298610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:29.299923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:29.301496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Returning 404 to user: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:14:29.301496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-083afeee-1ad2-4fdf-99e1-396ef46de315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034112 Sep 12 14:14:29.301496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 87/170] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:14:29 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:14:29.427719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:29.428456 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:29.434455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.435126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.435615 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.437319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:29.437961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:29.438685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:29.572638 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:29.581104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5191bdf6-fdab-4537-a975-4d2329a23787 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.157343 Sep 12 14:14:29.581874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 84/171] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:29 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:30.603701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:30.604339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:30.610810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:30.611613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:30.611851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:30.612538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:30.612987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:30.613512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:30.738068 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:30.745721 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-184a1c98-58d0-4258-a5c4-b4b9349621a6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.145894 Sep 12 14:14:30.746279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 88/172] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:30 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:31.768576 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:31.769384 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:31.776162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:31.776630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:31.777050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:31.777780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:31.778389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:31.778804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:31.924044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:31.931983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f982e259-7fc2-425b-9a7c-fa4e292c61a2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.167672 Sep 12 14:14:31.932551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 85/173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:31 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:32.624573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:32.625084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:32.631455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.631944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.632414 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:32.633140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.633593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.634039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:32.648268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] HTTP exception thrown: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Request method failure captured: Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 HTTP/1.1 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6JSNba6kzwD3NR3CSS1IKmrdgfbVHtvn_d1Yz-E1Dgo5MZwMG6sXptLUtolVqbIodRRCz5rxMsawZF-EUwv-FXb-7kOzVOHNogqBZVm4hvKZpJ44nfRJYrHvDzw0iUZcNmdjw5lXJjx0UQVmS5fkgkD0RENhicS4YU1fnocP2bkiU Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:14:32.650556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e73505faee9c4bacbf2456e2d69c56f2", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 1c6cd05ddb3d4d14b2a18bc45401e73d Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.652091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '608616b8-2ef0-4311-83f6-ff44bba4fa27'} Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:14:32.652842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.654141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.655621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Returning 404 to user: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:14:32.655621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0970053a-8703-4083-8c1d-4ba00e229cc0 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "DELETE /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 404 len: 111 microversion: 2.1 time: 0.032196 Sep 12 14:14:32.655621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 89/174] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:14:32 2022] DELETE /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:14:32.660523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:32.661363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] [instance: 608616b8-2ef0-4311-83f6-ff44bba4fa27] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:32.667321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.667793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.668220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:32.668900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.669348 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.669766 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:32.683628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] HTTP exception thrown: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Request method failure captured: Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 HTTP/1.1 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6JSNba6kzwD3NR3CSS1IKmrdgfbVHtvn_d1Yz-E1Dgo5MZwMG6sXptLUtolVqbIodRRCz5rxMsawZF-EUwv-FXb-7kOzVOHNogqBZVm4hvKZpJ44nfRJYrHvDzw0iUZcNmdjw5lXJjx0UQVmS5fkgkD0RENhicS4YU1fnocP2bkiU Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:14:32.685145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e73505faee9c4bacbf2456e2d69c56f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e73505faee9c4bacbf2456e2d69c56f2", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e73505faee9c4bacbf2456e2d69c56f2 Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-948662133 Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 1c6cd05ddb3d4d14b2a18bc45401e73d Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-948662133-project Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.687605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '608616b8-2ef0-4311-83f6-ff44bba4fa27'} Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:14:32.689243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. Sep 12 14:14:32.690270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:14:32.691324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] Returning 404 to user: Instance 608616b8-2ef0-4311-83f6-ff44bba4fa27 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:14:32.691324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ee2deeb-6556-4634-8bc1-1691b654d315 tempest-DeleteServersTestJSON-948662133 tempest-DeleteServersTestJSON-948662133-project] 10.222.0.42 "GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27" status: 404 len: 111 microversion: 2.1 time: 0.029745 Sep 12 14:14:32.691324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:32 2022] GET /compute/v2.1/servers/608616b8-2ef0-4311-83f6-ff44bba4fa27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:14:32.957092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:32.957802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:32.966515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.967595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.968266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:32.968953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:32.969560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:32.970291 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:33.131593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:33.150711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ec6997d2-0781-4fd2-aba6-dbbdbcc78832 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.198962 Sep 12 14:14:33.151848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:32 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:34.174301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:34.174827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:34.180869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:34.181351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:34.181787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:34.182473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:34.182957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:34.183387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:34.198554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:34.328540 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:34.337819 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49ce0738-4e34-4d29-89ab-cb19cf2a36cc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.167803 Sep 12 14:14:34.338882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 87/177] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:34 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:35.365161 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:35.366284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:35.372415 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:35.372903 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:35.373333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:35.374718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:35.375194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:35.375613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:35.701205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:35.711586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8cac8b8c-571a-4eb2-a05b-da957ff330d7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.354167 Sep 12 14:14:35.712696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 91/178] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:35 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:36.745211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:36.745820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:36.752528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:36.752990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:36.753417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:36.754293 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:36.755088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:36.755760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:36.926229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:36.935955 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28038b1d-e1f4-4796-bc64-b9c2622ac6ea tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.197746 Sep 12 14:14:36.936417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 88/179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:36 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:37.959944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:37.960610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:37.967936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:37.968416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:37.968843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:37.969530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:37.969976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:37.970391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:38.129678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:38.145919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea545bc3-ad37-4971-9cfe-3e4a4ec4d679 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.189688 Sep 12 14:14:38.147045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 92/180] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:37 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:39.169483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:39.170224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:39.181849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:39.183181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:39.183181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:39.183728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:39.184215 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:39.184637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:39.266647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1799716205", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:39.320942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:39.321638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] validate_networks() for None {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:14:39.329127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c72bcf1a-01b0-4017-a8fb-f4d2b7f61285 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.163493 Sep 12 14:14:39.329687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 89/181] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:39 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:39.841678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:14:39.842095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:14:39.842596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:14:39.843039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:14:39.843488 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:14:39.852344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:39.852819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:39.853244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:39.853963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:39.854410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:39.854875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:39.871727 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Getting quotas for project 7f946cd56d394d75935e5277811c39c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:14:39.876304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Getting quotas for user c7400d293884411b94618c5f3aac8c43 and project 7f946cd56d394d75935e5277811c39c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:14:39.887605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:14:39.890042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:14:39.936381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c2300752-8981-4ecb-9cfa-94f46997ac4c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674025 Sep 12 14:14:39.937026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 93/182] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 14:14:39.948212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f1482ef-0cb8-4a8c-809f-e0be3d2ee768 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:39.948822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f1482ef-0cb8-4a8c-809f-e0be3d2ee768 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:40.003188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f1482ef-0cb8-4a8c-809f-e0be3d2ee768 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:40.010033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f1482ef-0cb8-4a8c-809f-e0be3d2ee768 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1215 microversion: 2.1 time: 0.065609 Sep 12 14:14:40.010607 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 90/183] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:39 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:40.352933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:40.355873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:40.363123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:40.363603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:40.364226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:40.364935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:40.365393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:40.366069 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:40.552694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:40.560589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a3305863-4ece-4c6a-a284-2d69649456d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.212514 Sep 12 14:14:40.561337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 94/184] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:40 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:41.032380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:41.032996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:41.038772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:41.039283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:41.039723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:41.040404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:41.040861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:41.041282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:41.101845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:41.110341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2979265-211f-400d-a09c-44fbded4c8ca tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1267 microversion: 2.1 time: 0.081800 Sep 12 14:14:41.110928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:41 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:41.585797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:41.586403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:41.593378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:41.593853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:41.594281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:41.595000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:41.595453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:41.595877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:41.742467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:41.751605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-03aef73e-042a-4b2c-9d52-cc31bb196018 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.169539 Sep 12 14:14:41.753730 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 95/186] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:41 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:42.134677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:42.135380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:42.145062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:42.145510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:42.145938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:42.146797 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:42.147276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:42.147861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:42.303275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:42.313577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee533217-4467-44c0-8a98-f93c9d197671 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.182775 Sep 12 14:14:42.314445 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 92/187] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:42 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:42.774353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:42.774988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:42.781367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:42.781836 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:42.782262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:42.782968 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:42.783412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:42.783821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:42.908263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:42.915806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7bde25a5-770c-4507-9282-5cb8c9d2e4ac tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.145280 Sep 12 14:14:42.916368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 96/188] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:42 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:43.337322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:43.337944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:43.344004 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:43.344487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:43.344923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:43.345609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:43.346066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:43.346492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:43.473935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:43.481439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-059d1014-7d59-4319-9aef-1e7c9e692579 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.147907 Sep 12 14:14:43.482008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 93/189] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:43 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:43.938606 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:43.939482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:43.945758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:43.946227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:43.946647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:43.947348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:43.947791 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:43.948202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:44.071319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:44.079439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ce26508b-9894-41c5-a783-33923c3e2d83 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.144624 Sep 12 14:14:44.080004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 97/190] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:43 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:44.504364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:44.504975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:44.510939 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:44.511416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:44.511844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:44.512536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:44.512986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:44.513404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:44.638824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:44.646440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b972171-e62d-4db1-a3eb-8f4d594b6b6c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.145919 Sep 12 14:14:44.647046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 94/191] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:44 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:45.103174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:45.103779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:45.111552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:45.112400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:45.112835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:45.113564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:45.114168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:45.114619 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:45.263304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:45.272539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0c9c26a0-3cd5-4540-ab77-2bad88350455 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.173156 Sep 12 14:14:45.273358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 98/192] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:45 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:45.552782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea885468-1fb7-45fd-af5b-e8f92919c7be", "tag": "ef7ac331-4470-4830-8fad-bc428db6a2bf"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:45.564704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:45.576915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:45.577408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:45.577839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:45.595114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] Creating event network-changed:ef7ac331-4470-4830-8fad-bc428db6a2bf for instance ea885468-1fb7-45fd-af5b-e8f92919c7be on hv-cinder-82002 Sep 12 14:14:45.600695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fd97f711-c086-4689-b8c7-e7909d7e55f6 req-82776ca8-c71e-4c61-9eb5-27d62a6edbaf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051882 Sep 12 14:14:45.601607 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 95/193] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:45.670973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:45.671685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:45.678148 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:45.679027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:45.679468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:45.680168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:45.680622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:45.681045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:45.835243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:45.846231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3814f388-2d3b-428c-9462-22874d10d42d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.180080 Sep 12 14:14:45.847371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 99/194] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:45 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:46.297305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:46.298978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:46.310203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:46.310918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:46.311396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:46.312250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:46.312767 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:46.313190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:46.490594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:46.501599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3743156f-d83d-4436-ab63-9d954a90bc60 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.209754 Sep 12 14:14:46.502194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 96/195] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:46 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:46.872499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:46.873190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:46.881935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:46.882419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:46.882857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:46.883560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:46.884016 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:46.884420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:47.022019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:47.029666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40099d6e-813e-4e7f-a7d5-177491933378 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.160928 Sep 12 14:14:47.030238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 100/196] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:46 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:47.525111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:47.525641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:47.532584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:47.533075 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:47.533516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:47.534402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:47.535224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:47.535987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:47.681849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:47.692012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db2bb26c-f705-4993-a53c-68a7c072e5b1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.170688 Sep 12 14:14:47.708794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 97/197] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:47 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:48.053314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:48.053926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:48.060826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:48.061308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:48.061761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:48.062633 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:48.063129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:48.063543 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:48.215287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:48.223763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d927d376-9883-4074-a6df-2f56d9e21bf6 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.174369 Sep 12 14:14:48.237233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 101/198] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:48 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:48.719131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:48.719843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:48.725925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:48.726398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:48.726822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:48.727518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:48.727961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:48.728376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:48.861076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:48.869397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa0d94ff-839a-42e6-bcea-93e6465e68f1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.154202 Sep 12 14:14:48.869965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 98/199] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:48 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:49.247863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:49.248474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:49.254997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:49.255476 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:49.255905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:49.256598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:49.257046 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:49.257461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:49.387769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:49.395982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a318a998-b4d0-4e3b-8a7a-a53ef80eaf6d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.152033 Sep 12 14:14:49.396533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 102/200] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:49 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:49.895442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:49.896111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:49.901798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:49.902272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:49.902883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:49.903412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:49.903854 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:49.904444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:50.008210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.076593 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:50.086137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97224f13-2882-433c-81be-dee893e488cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.194525 Sep 12 14:14:50.087004 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 99/201] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:49 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:50.418882 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:50.419494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:50.421350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.421943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.423393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:50.429764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:50.430465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:50.430654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:50.431422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:50.431872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:50.432282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:50.612710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:50.620717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-369ea9c1-e5af-49c8-9f7e-3ca795861cc1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.205592 Sep 12 14:14:50.621307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 103/202] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:50 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:51.108750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:51.109488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:51.115859 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:51.116346 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:51.116799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:51.117471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:51.117932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:51.118357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:51.249917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:51.257672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f28af698-5426-4dca-84e5-045a3931823d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.153041 Sep 12 14:14:51.258235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 100/203] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:51 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:51.644521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:51.645130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:51.651464 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:51.651941 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:51.652373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:51.653053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:51.653502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:51.653921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:51.825172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:51.833229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a20bd83-4c83-4cee-a396-829622ac14c0 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.192566 Sep 12 14:14:51.849040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 104/204] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:51 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:52.094799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea885468-1fb7-45fd-af5b-e8f92919c7be", "name": "network-vif-plugged", "status": "completed", "tag": "ef7ac331-4470-4830-8fad-bc428db6a2bf"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:52.104402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:52.104862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:52.105296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:52.116884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] Creating event network-vif-plugged:ef7ac331-4470-4830-8fad-bc428db6a2bf for instance ea885468-1fb7-45fd-af5b-e8f92919c7be on hv-cinder-82002 Sep 12 14:14:52.122628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f2c2a73e-f404-47bf-be54-7abb8cc61843 req-4a530f21-483f-474e-87a9-07d80930433c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Sep 12 14:14:52.123260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 101/205] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:14:52.281000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:52.281572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:52.287533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:52.288013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:52.288449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:52.289132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:52.289588 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:52.290011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:52.306235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:52.420431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:52.428139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6c935920-4bd1-4411-9c5e-1a64121e3114 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1520 microversion: 2.1 time: 0.151716 Sep 12 14:14:52.428705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 105/206] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:52 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:52.856677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:52.857506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:52.863835 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:52.864319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:52.864754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:52.865444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:52.865895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:52.866324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:52.996590 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:53.004966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68efa2d9-2aab-4300-8995-042b25b66b4f tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.152636 Sep 12 14:14:53.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 102/207] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:52 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:53.450913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:53.451737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:53.459418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:53.460091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:53.460672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:53.461858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:53.462458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:53.463061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:53.596712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:53.604383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-726c3cee-d7f0-4112-a39a-b3ef1b64e274 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1500 microversion: 2.1 time: 0.157350 Sep 12 14:14:53.604953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 106/208] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:53 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:53.627590 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:53.628264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:53.634070 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:53.634541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:53.635009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:53.635683 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:53.636124 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:53.636538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:53.771605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:53.780782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e298076-347b-4435-931d-90e110878427 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1514 microversion: 2.1 time: 0.157653 Sep 12 14:14:53.781980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 103/209] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:53 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:54.028558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:54.029462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:54.035396 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:54.036106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:54.036534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:54.037686 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:54.038140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:54.038562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:54.196295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:54.204651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f6481e70-863f-433c-9d57-2672c29e22f5 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.180052 Sep 12 14:14:54.205299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 107/210] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:54 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:55.175318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:14:55.178157 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:55.185216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.185700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.186673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.187394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.187845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.188266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.212461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'flavor' on Instance uuid 88d23509-c830-4101-bcd2-9f320baffe8e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:14:55.227935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:55.228544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:55.235044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.235554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.235978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.236654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.237101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.237595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.314005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:14:55.339484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9aa31fb8-f79b-4722-89ca-b94ebbf4fa76 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/action" status: 200 len: 32 microversion: 2.1 time: 0.168074 Sep 12 14:14:55.340186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 104/211] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:14:55 2022] POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:14:55.351806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:55.352618 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:55.360805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.361946 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.362397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.363254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:55.364136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:55.364581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:55.384253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:55.401571 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6750551-2d46-4ea3-9dda-fd1a41dd2ed2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.177899 Sep 12 14:14:55.402464 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 108/212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:55 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:55.519084 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:55.526699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c24f717b-0f14-489b-b11b-54e2cb688532 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.180295 Sep 12 14:14:55.527297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 105/213] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:55 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:56.424968 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:56.425741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:56.433273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:56.433769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:56.434206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:56.434949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:56.435516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:56.437929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:56.550494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:56.551480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:56.558686 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:56.559721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:56.560396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:56.562530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:56.563264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:56.564213 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:56.593898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:56.603521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5f80b4bf-30a1-478e-a60f-c7c8f9ccc56b tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.182485 Sep 12 14:14:56.604107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 109/214] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:56 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:56.696681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:56.704289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5cce2b18-0d08-4caf-88d8-2cb9e7a5d474 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.157902 Sep 12 14:14:56.704860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 106/215] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:56 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:57.625314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:57.625930 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:57.632257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:57.632730 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:57.633155 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:57.633831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:57.634277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:57.634694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:57.726970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:57.727718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:57.734324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:57.734806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:57.735265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:57.735947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:57.736416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:57.736814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:57.759335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:57.766948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cffa5cfb-8c57-4d2a-b1cf-0c03b022b25d tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1315 microversion: 2.1 time: 0.145409 Sep 12 14:14:57.767511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 110/216] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:57 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:57.870784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:57.879120 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78c552f4-4d48-435e-be75-d83341ae2eef tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.155947 Sep 12 14:14:57.879814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 107/217] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:57 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:58.792578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:58.793193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:58.799651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:58.800130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:58.800563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:58.801244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:58.801695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:58.802116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:58.902103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:58.902705 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:58.909184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:58.909662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:58.910089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:58.910769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:58.911255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:58.911672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:58.938239 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:58.947649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-632ba2dd-12d4-4f43-b606-5a237a72cee1 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1465 microversion: 2.1 time: 0.158470 Sep 12 14:14:58.948637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 111/218] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:58 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:14:59.000399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:59.001003 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:59.007181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:59.007665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:59.008096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:59.008789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:59.009273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:59.009690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:59.036900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:14:59.043897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:59.052074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69166c3c-2115-49d1-ba31-7b6c84665330 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.153840 Sep 12 14:14:59.052643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 108/219] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:58 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:14:59.120317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0b5c1fad-9ac8-49d8-a97d-20a6a60be293 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 204 len: 0 microversion: 2.1 time: 0.123948 Sep 12 14:14:59.120916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 112/220] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:14:58 2022] DELETE /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:14:59.130130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:14:59.130822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:14:59.136873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:59.137284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:59.137704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:59.138378 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:14:59.138868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:14:59.139282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:14:59.267148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:14:59.275720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54757b6d-0d07-40dd-a50c-4bc3d8e1e45c tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1471 microversion: 2.1 time: 0.149778 Sep 12 14:14:59.276293 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 109/221] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:14:59 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:00.077328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:00.078034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:00.085007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:00.085488 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:00.085919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:00.086605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:00.087087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:00.087512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:00.215270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:00.223430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-502ba2ab-e3d5-4be5-adce-380a36ba3865 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.151207 Sep 12 14:15:00.224014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 113/222] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:00 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:00.299721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:00.300327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:00.306319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:00.306794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:00.307251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:00.307929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:00.308373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:00.308790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:00.450362 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:00.458127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba26e4cb-869d-491e-99f3-a2a7936ba76a tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1471 microversion: 2.1 time: 0.162914 Sep 12 14:15:00.458685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 110/223] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:00 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:01.246863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:01.247490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:01.255706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.256380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.256973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.257916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.258366 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.258969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.275396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea885468-1fb7-45fd-af5b-e8f92919c7be", "name": "network-vif-deleted", "tag": "ef7ac331-4470-4830-8fad-bc428db6a2bf"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:01.292032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.292519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.293225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.309539 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] Creating event network-vif-deleted:ef7ac331-4470-4830-8fad-bc428db6a2bf for instance ea885468-1fb7-45fd-af5b-e8f92919c7be on hv-cinder-82002 Sep 12 14:15:01.319544 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c5e3bd64-7fbb-4b39-8c7a-f93a6d0e5b39 req-30bee295-d0d6-40e1-a0c2-d6c47ee7e60b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051612 Sep 12 14:15:01.320150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 111/224] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:15:01.427934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:01.437657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3176a868-0928-485c-8e7f-c3508e573883 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.193534 Sep 12 14:15:01.437657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 114/225] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:01 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:01.492735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:01.493402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:01.501058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.501677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.502376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.503155 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.504050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.505131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.561698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:01.562995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:01.564282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:01.565013 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lazy-loading 'fault' on Instance uuid ea885468-1fb7-45fd-af5b-e8f92919c7be {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:15:01.618810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:01.627188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-419369e6-1631-4746-8721-2708f6a2fdb2 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1305 microversion: 2.1 time: 0.149304 Sep 12 14:15:01.627787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 112/226] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:01 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:02.464674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:02.465286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:02.471735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:02.472235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:02.472652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:02.473333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:02.473790 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:02.474210 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:02.601593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:02.609235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2cc9ce09-6671-4de0-b197-c58dfe7ef7a1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.148466 Sep 12 14:15:02.609800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 115/227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:02 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:02.650522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:02.651156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:02.657685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:02.658045 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:02.658484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:02.659208 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:02.659665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:02.660148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:02.691079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:02.691561 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:02.691997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:02.692454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lazy-loading 'fault' on Instance uuid ea885468-1fb7-45fd-af5b-e8f92919c7be {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:15:02.735564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7400d293884411b94618c5f3aac8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f946cd56d394d75935e5277811c39c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:02.743465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3668a78-cca2-405a-a255-0caebef79790 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 200 len: 1305 microversion: 2.1 time: 0.096672 Sep 12 14:15:02.744042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 113/228] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:02 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:03.632201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:03.633847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:03.641355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:03.641826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:03.642252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:03.642960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:03.643406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:03.643822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:03.765842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:03.766689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] [instance: ea885468-1fb7-45fd-af5b-e8f92919c7be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:03.772808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:03.773289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:03.773721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:03.774392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:03.774533 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:03.774878 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:03.775303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:03.783312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c1f93163-8da5-47c6-b69f-01b25ec869d9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.154792 Sep 12 14:15:03.784143 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 116/229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:03 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:03.789541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] HTTP exception thrown: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Request method failure captured: Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be HTTP/1.1 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz7MgT9tE5ptc-WJVYAZzwR3ZgGT2z6o_9Af2J9Jayuje1Se7pB0nAd1FnSgd36CkN_FkwNTBzmkV7zYhVZ-_OnZ64Xk1oMSnODGKlIW7w2qZp4i3qtJsObineDJnOIko2_YKqRLOjf-Kfa9e47MhW8cTNwqPAHwQKVLaWA_yHArqa0 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7f946cd56d394d75935e5277811c39c7 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-380003808 Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:15:03.791325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f946cd56d394d75935e5277811c39c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f946cd56d394d75935e5277811c39c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f946cd56d394d75935e5277811c39c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f946cd56d394d75935e5277811c39c7", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-380003808 Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7f946cd56d394d75935e5277811c39c7 Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-380003808 Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-380003808-project Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: c7400d293884411b94618c5f3aac8c43 Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-380003808-project Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. Sep 12 14:15:03.792827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'ea885468-1fb7-45fd-af5b-e8f92919c7be'} Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:15:03.793689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. Sep 12 14:15:03.795673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:15:03.797492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] Returning 404 to user: Instance ea885468-1fb7-45fd-af5b-e8f92919c7be could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:15:03.798350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9f7b860-5843-48e4-bc68-71ceb313f561 tempest-VolumesNegativeTest-380003808 tempest-VolumesNegativeTest-380003808-project] 10.222.0.42 "GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be" status: 404 len: 111 microversion: 2.1 time: 0.036347 Sep 12 14:15:03.799036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 114/230] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:03 2022] GET /compute/v2.1/servers/ea885468-1fb7-45fd-af5b-e8f92919c7be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:15:04.806910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:04.807521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:04.814173 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:04.814647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:04.815099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:04.815963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:04.816218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:04.816671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:04.953642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:04.961240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bd5d481f-3562-4e02-ae47-0d95173be099 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.158397 Sep 12 14:15:04.961796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 117/231] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:04 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:05.984176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:05.984792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:05.990807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:05.991386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:05.991968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:05.992716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:05.993251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:05.993755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:06.124597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:06.132397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9580a4b8-ded5-46bf-bd3f-54a1e396c4e5 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.151984 Sep 12 14:15:06.133121 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 115/232] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:05 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:07.154212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:07.154795 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:07.161906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:07.162407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:07.162868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:07.163546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:07.163998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:07.164416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:07.437949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:07.445921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f219f584-6a5b-404c-a63b-dd81e94b40df tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.295514 Sep 12 14:15:07.446489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 118/233] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:07 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:08.469113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:08.469644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:08.475616 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:08.476094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:08.476522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:08.477198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:08.477645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:08.478058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:08.603204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:08.611453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f06b3d41-09f6-4411-8527-e44272e5af49 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.146814 Sep 12 14:15:08.612014 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 116/234] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:08 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:09.634456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:09.635131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:09.641573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:09.642054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:09.642483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:09.643190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:09.643642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:09.644067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:09.772260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:09.779862 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-332dc7c0-76aa-47b4-ad33-23945f02c2cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.149229 Sep 12 14:15:09.780424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 119/235] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:09 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:10.801975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:10.802611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:10.808935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:10.809412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:10.809842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:10.810519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:10.810999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:10.811929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:10.936726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:10.944533 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bd5b257-1720-4811-a805-440fa42d0bb6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.146506 Sep 12 14:15:10.945089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 117/236] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:10 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:11.727319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:11.727918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:11.734672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:11.735183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:11.735612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:11.736296 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:11.736745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:11.737169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:11.751121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:11.762248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1c8f68f7-db10-4769-9a61-ec340c070c4c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/ips" status: 200 len: 145 microversion: 2.1 time: 0.039030 Sep 12 14:15:11.762804 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 120/237] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:15:11 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:11.968693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:11.969311 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:11.975271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:11.975925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:11.976413 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:11.977095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:11.977548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:11.977971 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:12.275106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:12.283016 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdbcc4f0-a473-4168-a633-f47ae44fe5d8 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.318882 Sep 12 14:15:12.283814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 118/238] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:11 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:13.306378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:13.307059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:13.322384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:13.322906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:13.323338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:13.324045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:13.324494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:13.324974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:13.505067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:13.512670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c26041ca-3ecf-4fe2-904a-ea49342fcb97 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.210698 Sep 12 14:15:13.528067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 121/239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:13 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:14.542321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:14.542321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:14.549961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:14.550460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:14.550900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:14.551700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:14.552048 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:14.552466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:14.701212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:14.709277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78d0a84d-268e-46df-9c12-68fbfd07b528 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.174321 Sep 12 14:15:14.709877 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 119/240] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:14 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:15.016450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3b21e7-439d-421d-9215-b8d600f10406"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:15.018883 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:15.025269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:15.025813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:15.026286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:15.027075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:15.027525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:15.027993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:15.733420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:15.734037 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:15.744742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-153fa366-4ba4-4f44-9ade-9fce0ba8843b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710630 Sep 12 14:15:15.747358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=54 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:15.749972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 122/241] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:15:15 2022] POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:15.765537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:15.765537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:15.765537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:15.765537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:15.765845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:15.765845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:15.932396 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-491457939", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "networks": [{"uuid": "a8d56a03-43b5-4483-b95f-c332a61e44c8"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:15.979872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:15.987327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] validate_networks() for [('a8d56a03-43b5-4483-b95f-c332a61e44c8', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:15:15.988160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14efb91a-a1e0-45aa-9d4a-5815ec3f0496 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.258524 Sep 12 14:15:15.991659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 120/242] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:15 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:16.335360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:15:16.335729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:15:16.336131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:15:16.336564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:15:16.336970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:15:16.346356 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:16.346865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:16.347284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:16.347998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:16.348454 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:16.348868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:16.367960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Getting quotas for project 34866fb3f98042d38c922bf3552c4e69. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:15:16.371901 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Getting quotas for user 02fd338d362a461a846a454c487bf669 and project 34866fb3f98042d38c922bf3552c4e69. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:15:16.382686 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:15:16.385047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:15:16.432416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5d4f24b1-fa8b-420e-9e70-1be17c50032f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504792 Sep 12 14:15:16.433078 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 123/243] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 14:15:16.444427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7b33c4f-ffd8-433c-b64b-15131b7bf04b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:16.445132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7b33c4f-ffd8-433c-b64b-15131b7bf04b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:16.497995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7b33c4f-ffd8-433c-b64b-15131b7bf04b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:16.505710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7b33c4f-ffd8-433c-b64b-15131b7bf04b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1218 microversion: 2.1 time: 0.065276 Sep 12 14:15:16.506272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 121/244] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:16 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:17.012471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:17.013081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:17.020169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.021293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.021687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.023245 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.023918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.024344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.183220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:17.193782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-da4e18e6-7b05-4ff4-a898-64e154898d0f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.185393 Sep 12 14:15:17.194638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 124/245] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:17 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:17.309073 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:17.309718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:17.318761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.319291 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.319738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.320942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.321364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.344776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6e5377f-501e-46b0-8611-397ad123f5bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039384 Sep 12 14:15:17.345343 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 122/246] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:15:17 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:17.528858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:17.529469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:17.536047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.536589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.537193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.538064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:17.538526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:17.538976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:17.619641 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:17.627733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-501f7932-7cc0-4e93-8f77-1ec96beec853 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1214 microversion: 2.1 time: 0.102635 Sep 12 14:15:17.628723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 125/247] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:17 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:18.219386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:18.219913 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:18.225830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.226310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.226743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.227446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.227901 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.228322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.230792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:18.357452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:18.365191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2322402-c680-47d1-a803-30b4039e7fe6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1500 microversion: 2.1 time: 0.149825 Sep 12 14:15:18.365754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 123/248] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:18 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:18.387754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e97a5cf-04ed-4845-b3c2-8f649454993e"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:18.390805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:18.397131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.397596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.398027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.398712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.399188 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.399609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.422102 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] HTTP exception thrown: Cannot 'attach_volume' instance 88d23509-c830-4101-bcd2-9f320baffe8e while it is in vm_state rescued Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Request method failure captured: Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/os-volume_attachments HTTP/1.1 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 74 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6HAqeH4uA3THeEGY66TmW5JFBqWWE6VpSBn2DgT2hzfK6cFQaPP-DmHN_WeZH75AWmbdIxbQcEkPjoMLx-9xqcmEh2mxfQhVnpA9e5v8hXSpDeNE-mwuUeutYx92Xui3Up3pd3VwO8qGdy7u_VzHkty0JwerxP-SgskOZlk6dGQsE Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:15:18.423799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366826b14e0e4a93819c18d8d716a254", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 5f2ff5e497b64e49b7ac25a941a06048 Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {"volumeAttachment": {"volumeId": "7e97a5cf-04ed-4845-b3c2-8f649454993e"}} Sep 12 14:15:18.425207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Cannot 'attach_volume' instance 88d23509-c830-4101-bcd2-9f320baffe8e while it is in vm_state rescued Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'server_id': '88d23509-c830-4101-bcd2-9f320baffe8e', 'body': {'volumeAttachment': {'volumeId': '7e97a5cf-04ed-4845-b3c2-8f649454993e'}}} Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88d23509-c830-4101-bcd2-9f320baffe8e in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:15:18.426047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 88d23509-c830-4101-bcd2-9f320baffe8e while it is in vm_state rescued Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:15:18.427371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 88d23509-c830-4101-bcd2-9f320baffe8e while it is in vm_state rescued Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Returning 409 to user: Cannot 'attach_volume' instance 88d23509-c830-4101-bcd2-9f320baffe8e while it is in vm_state rescued {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7e491dfe-7b62-402f-bf86-1c078cf4ec11 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041476 Sep 12 14:15:18.428697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 126/249] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:15:18 2022] POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 14:15:18.434029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:18.434564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:18.441160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.441637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.442068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.442747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.443226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.443648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.506124 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f43a3ad-89dc-4cbd-a932-299e92ea7443 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/action" status: 202 len: 0 microversion: 2.1 time: 0.075601 Sep 12 14:15:18.506661 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 124/250] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:15:18 2022] POST /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:15:18.515370 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:18.515979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:18.521849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.522368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.522801 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.523505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.523953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.524371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.649829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:18.651837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:18.652515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:18.657642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b5d85a2a-79fa-4778-882d-ba47f044305e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1508 microversion: 2.1 time: 0.146623 Sep 12 14:15:18.658208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 127/251] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:18 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:18.658808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.659315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.659739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.660421 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:18.660967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:18.661452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:18.724426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:18.732370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec5beabe-d238-4c65-b788-bcb74d3df377 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1214 microversion: 2.1 time: 0.084768 Sep 12 14:15:18.733449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 125/252] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:18 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:19.681604 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:19.682114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:19.689261 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:19.689732 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:19.690158 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:19.690830 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:19.691299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:19.691715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:19.755454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:19.756085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:19.762119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:19.762595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:19.763060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:19.763741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:19.764833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:19.765247 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:19.836082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:19.843814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-409abce9-499f-4506-9f68-00c85c04f433 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1214 microversion: 2.1 time: 0.092198 Sep 12 14:15:19.844402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:19 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:19.850463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:19.858122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-09417bc5-63ea-4e64-ac85-f1a5bd1901f6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1508 microversion: 2.1 time: 0.180468 Sep 12 14:15:19.858676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 128/254] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:19 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:20.866402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:20.867043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:20.873157 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.875360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.875360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:20.875727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.876186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.876670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:20.876923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f52634e8-cf35-4987-8c5a-d0d4509e7aa7"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:20.879253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:20.881636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:20.888131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.888611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.889184 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:20.889899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.890352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.890773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:20.938276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:20.946930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-182569f6-885c-4a63-9f63-da6705d1ed37 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1270 microversion: 2.1 time: 0.084276 Sep 12 14:15:20.947498 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 127/255] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:20 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:20.951923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:20.952518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:20.958040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.958508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.972128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:20.973094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:20.973674 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:20.974104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:21.202189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:21.213231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-312af152-210c-408d-9dbf-20661645d5cb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1508 microversion: 2.1 time: 0.264583 Sep 12 14:15:21.213889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 128/256] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:20 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:21.247832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b67e357b-6202-4ec8-acc1-ade407b91df9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375373 Sep 12 14:15:21.251214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 129/257] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:15:20 2022] POST /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:15:21.974447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:21.975833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:21.983302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:21.984098 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:21.984835 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:21.985874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:21.986539 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:21.987342 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:22.143850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:22.151548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdbbf648-de5e-4553-adba-930a2aa7a414 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.181390 Sep 12 14:15:22.152077 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 129/258] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:21 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:22.239477 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:22.240224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:22.246325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:22.246812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:22.247275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:22.247964 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:22.248418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:22.248950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:22.399932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:22.408177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-45b71510-f37f-45e4-8075-0b647550e9ec tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1508 microversion: 2.1 time: 0.173494 Sep 12 14:15:22.408772 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:22 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:23.177790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:23.181292 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:23.193152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:23.193788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:23.194230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:23.194949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:23.195405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:23.195826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:23.433087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:23.433815 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:23.445842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:23.447058 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:23.450774 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:23.452625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:23.457608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:23.468292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:23.680951 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:23.697312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f266cd4b-149e-47b1-b3d6-7d7dec84c28e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.525198 Sep 12 14:15:23.698950 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 130/260] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:23 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:23.704869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673ee208-578b-46e3-b4e0-ebd0ad4f57d6", "tag": "47d4c7fb-4320-44f1-8f93-b2a672d8d322"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:23.715217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:23.715699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:23.716125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:23.730390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] Creating event network-changed:47d4c7fb-4320-44f1-8f93-b2a672d8d322 for instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 on hv-cinder-82002 Sep 12 14:15:23.737394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ec20448b-4f90-4bd5-87cf-3954205b3736 req-bc6deedf-6ef0-4844-a3de-bc77d27335b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036575 Sep 12 14:15:23.738122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 131/261] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:23.780421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:23.788219 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-006db46e-ba8b-4563-b716-ccd5264fe80c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1514 microversion: 2.1 time: 0.360693 Sep 12 14:15:23.788790 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 131/262] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:23 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:24.721172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:24.722042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:24.729489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:24.730517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:24.731116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:24.731853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:24.732313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:24.733264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:24.989008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:25.000407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d0a718d-9821-4010-b9ba-d86b63c0fcdf tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.283655 Sep 12 14:15:25.001159 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 132/263] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:24 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:25.166778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a70a77f-a8eb-4375-a035-36aec8dec0b3 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: .version_select at 0x7f7560dcb040>, body: {"keypair": {"name": "tempest-keypair-143412044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOukhbRUX90SrQd+j+6ltVaJmLC7kshly/v5fQgfxiLkHn8A59dJ4NS6/cZWOubzFsukKyQNXMlLUhoQhkWYWdltzp4FoD0SyblxApmCJ+xlIW0zujkR7RRKfWz2FhPuQ=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:25.185030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1a70a77f-a8eb-4375-a035-36aec8dec0b3 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for project 366826b14e0e4a93819c18d8d716a254. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:15:25.190166 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-1a70a77f-a8eb-4375-a035-36aec8dec0b3 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for user 5f2ff5e497b64e49b7ac25a941a06048 and project 366826b14e0e4a93819c18d8d716a254. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:15:25.213723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a70a77f-a8eb-4375-a035-36aec8dec0b3 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051569 Sep 12 14:15:25.214617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 132/264] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:15:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:25.627794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:25.633804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:25.634290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:25.634714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:25.701242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 14:15:25.749088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86cdc239-c446-46d3-ba84-d563836e2ab7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action" status: 202 len: 0 microversion: 2.1 time: 0.126304 Sep 12 14:15:25.750619 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 133/265] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:15:25 2022] POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:15:25.758577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:25.759213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:25.765390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:25.766023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:25.766455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:25.767165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:25.767612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:25.768084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:25.902591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:25.903523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:25.911909 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:25.912695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:25.913354 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:25.914290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:25.914972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:25.915811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:25.920925 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:25.932041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-267a1a3d-cfd5-4915-8c0f-77226a82f873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.177283 Sep 12 14:15:25.932724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 133/266] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:25 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:25.942956 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-731f1dbe-2990-45c9-8766-aa2608e21f63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/ips" status: 200 len: 150 microversion: 2.20 time: 0.046755 Sep 12 14:15:25.951471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 134/267] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Sep 12 14:15:25 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:15:26.023818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:26.024800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:26.032345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:26.033052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:26.033692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:26.034597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:26.035282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:26.035924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:26.193538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:26.205338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8379057f-2fa1-436c-bdab-45ee91e0459a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.185195 Sep 12 14:15:26.205929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 134/268] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:26 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:26.736545 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680121159", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83e51b0e-db79-49cd-8380-4c9b5dcda3fe"}], "security_groups": [{"name": "tempest-securitygroup--3488251"}], "key_name": "tempest-keypair-143412044", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:26.745150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:26.851940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] validate_networks() for [('83e51b0e-db79-49cd-8380-4c9b5dcda3fe', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:15:26.956744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:26.958348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:26.960580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:26.966725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:26.967250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:26.967849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:26.968734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:26.969187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:26.969789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:27.181847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:27.190567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea9b3e07-9831-48cf-97d0-8c5bbafc792e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.238233 Sep 12 14:15:27.191180 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 135/269] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:26 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:27.228442 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:27.229034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:27.235690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:27.236104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:27.236532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:27.237232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:27.237683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:27.238099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:27.335935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:15:27.336425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:15:27.336966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:15:27.337555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:15:27.338026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:15:27.347581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:27.348164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:27.348657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:27.349373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:27.349817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:27.350233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:27.368568 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:15:27.372521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Getting quotas for user 5f2ff5e497b64e49b7ac25a941a06048 and project 366826b14e0e4a93819c18d8d716a254. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:15:27.383583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:15:27.385925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:15:27.393846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:27.396131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:27.416211 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6e6990b4-b375-4bf9-ad67-50529e542665 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.191313 Sep 12 14:15:27.416901 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 136/270] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:27 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:27.438219 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91db0f59-8a1d-4b1c-8ffd-9d09baea7ed1 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706289 Sep 12 14:15:27.439170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 135/271] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:15:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 14:15:27.450914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8abcf83e-9ab8-4b47-bd9c-dce627db108f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:27.451574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8abcf83e-9ab8-4b47-bd9c-dce627db108f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:27.505378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8abcf83e-9ab8-4b47-bd9c-dce627db108f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:27.512394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8abcf83e-9ab8-4b47-bd9c-dce627db108f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1244 microversion: 2.1 time: 0.066106 Sep 12 14:15:27.513179 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:27 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1244 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:28.213374 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:28.214548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:28.222483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.223268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.223676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.226929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.227557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.228135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.394942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:28.407523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4556d30e-095a-4887-9751-7eefd147391e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.197860 Sep 12 14:15:28.408103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 136/273] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:28 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:28.441247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:28.441858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:28.448466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.448813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.449236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.449917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.450364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.450776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.481488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:28.482110 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:28.489241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.489798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.490313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.491128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.491645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.492128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.516631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lazy-loading 'flavor' on Instance uuid 124f260e-ab17-46a8-a63d-33ee552dbac2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:15:28.586783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:28.590411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:28.594947 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b848dcdf-f1f4-4412-b5eb-a8bfb9b3f4a7 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.157767 Sep 12 14:15:28.595444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 138/274] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:28 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:28.600769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:28.601460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:28.623780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.624244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.624680 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.625575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.626096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.626705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.693858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:28.701683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1b5d88e9-6840-4fa4-a634-784fe33bd924 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1296 microversion: 2.1 time: 0.104395 Sep 12 14:15:28.702363 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 139/275] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:28 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:28.769412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c451541a-864e-4edf-970a-fc3a95e77d8d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/action" status: 202 len: 0 microversion: 2.20 time: 0.291686 Sep 12 14:15:28.770817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 137/276] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 12 14:15:28 2022] POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:15:28.782729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:28.792595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:28.801986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.802764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.803353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.804202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:28.805024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:28.805895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:28.988336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.001213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.003551 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.005781 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c754c7ec-4b54-4c58-ad5d-77863885a639 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.229824 Sep 12 14:15:29.006125 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 140/277] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:28 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:29.432135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:29.432826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:29.439745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.440220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.440648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.441325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.441772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.442185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.578610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.586936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe62a38e-c2c3-48eb-a5b5-f44a61f0aa97 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.158979 Sep 12 14:15:29.587721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 138/278] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:29 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:29.626187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:29.627329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:29.635034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.635527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.635962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.636884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.637356 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.637761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.725480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:29.726474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:29.737623 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.738110 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.743893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.744641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:29.745110 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:29.745534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:29.803622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.820565 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95f447f8-fa25-4316-af66-9355faafd6ff tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.198462 Sep 12 14:15:29.821264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 141/279] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:29 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:29.930425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:29.939856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ad9b297-39a2-4f71-97ea-ed6cf5aa61b4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.217424 Sep 12 14:15:29.940668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 139/280] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:29 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:30.033623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:30.034133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:30.040228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.040705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.041378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.042320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.043062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.043589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.206620 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:30.215961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:30.226788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:30.228520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cf80422c-b619-4013-89fc-bd8f113d384f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.198777 Sep 12 14:15:30.229967 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 142/281] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:30 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:30.318930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673ee208-578b-46e3-b4e0-ebd0ad4f57d6", "name": "network-vif-plugged", "status": "completed", "tag": "47d4c7fb-4320-44f1-8f93-b2a672d8d322"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:30.329210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.329924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.330641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.347606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] Creating event network-vif-plugged:47d4c7fb-4320-44f1-8f93-b2a672d8d322 for instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 on hv-cinder-82002 Sep 12 14:15:30.354229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a519dfe1-81da-46c2-9f51-ed28cbfd328f req-c06fccae-b609-44f2-a430-4770db13eb00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038785 Sep 12 14:15:30.355329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 140/282] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:30.480524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:30.496377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.496847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.497264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.509574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] Creating event network-changed:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:15:30.515159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-7d380449-8104-4abe-a252-017a3e5de93b req-59fbd29a-e871-4f1c-8f45-f6d8ea174999 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044045 Sep 12 14:15:30.515760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 143/283] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:30.611341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:30.611976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:30.618620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.619169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.619603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.620328 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.620853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.621280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.754494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:30.768015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-168de067-fd51-46c3-9f5e-a630449f0b32 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.156918 Sep 12 14:15:30.768631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 141/284] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:30 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:30.852333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:30.853031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:30.861103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.861921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.862762 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.863710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.864976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.865622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.962963 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:30.963833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:30.973208 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.975469 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.976210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:30.977242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:30.977988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:30.978689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:31.065466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.074277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1ef5e69c-5de3-426f-90c4-80de4c0ed0bb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.229035 Sep 12 14:15:31.084430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 144/285] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:30 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:31.146792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.154502 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05218f24-30be-4f93-93eb-c7691abcaf0c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.195934 Sep 12 14:15:31.155118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 142/286] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:30 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:31.257961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:31.259575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:31.267129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:31.268416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:31.269155 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:31.270407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:31.270959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:31.271567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:31.466256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.474569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.476649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.477831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8aa70ef2-d8dd-4582-baf9-d156a8ee249f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.225706 Sep 12 14:15:31.478402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 145/287] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:31 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:31.793587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:31.794338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:31.801450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:31.801927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:31.802356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:31.803068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:31.803707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:31.804352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:31.941834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:31.950262 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ad9ffc4-cd69-49ef-97ee-071cc7a56104 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.160900 Sep 12 14:15:31.950856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 143/288] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:31 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:32.099064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:32.103118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:32.111170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.111655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.112092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.112963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.113426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.113849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.165579 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07d991a7-6c10-46d1-98bd-e25c9e218354 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: .version_select at 0x7f7560cdf0d0>, body: {"keypair": {"name": "tempest-keypair-2126430200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTsOMgD3xbSEW0WlHBer03QCYrGo2Mc1Tqqb4Eb6Ru2ijPy3FYg+4hkwZ6LY36+jNfuzwrZAsK76MGkrepVWLkpFhhtZ20tDdaDbJyj2nTs+uagFSIKVE01IrdLab27eA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:32.180796 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-07d991a7-6c10-46d1-98bd-e25c9e218354 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:15:32.184935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-07d991a7-6c10-46d1-98bd-e25c9e218354 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:15:32.214683 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07d991a7-6c10-46d1-98bd-e25c9e218354 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052921 Sep 12 14:15:32.219187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 144/289] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:15:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:15:32.227466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:32.228143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:32.239720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.240901 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.241503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.242335 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.242921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.243356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.266383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:32.276022 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0058ae01-d942-4882-90a6-224067832753 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.180878 Sep 12 14:15:32.277174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 146/290] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:32 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:32.400709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:32.410913 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ceee29e8-3220-462e-bf87-38f522d104b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.190091 Sep 12 14:15:32.426855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:32 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:32.504509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:32.505215 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:32.512038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.512806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.513466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.514371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.516040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.517021 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.665133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:32.674038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:32.675756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:32.676987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e1d7536e-7c6d-48ec-9dd8-dce0962ea6d9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.176345 Sep 12 14:15:32.677738 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 147/292] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:32 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:32.973443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:32.974557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:32.981064 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.981736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.982168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:32.982870 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:32.983890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:32.984314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.231372 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.242123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ee4b3ea-b970-4be4-9827-dcfc20f78e55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.272570 Sep 12 14:15:33.243274 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 146/293] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:32 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:33.301797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:33.304121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:33.311013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.311531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.311962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.312656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.313108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.313937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.434691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:33.435132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:33.441685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.442424 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.442883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.443586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.444040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.444657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.653317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.668380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a4fc33a9-d549-4594-9f62-b21d80596858 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1318 microversion: 2.1 time: 0.369134 Sep 12 14:15:33.669575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 148/294] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:33 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:33.704825 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:33.705561 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:33.713372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.713936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.714556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.715091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:33.715547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:33.715973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:33.727906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.738212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a513a7a-3583-426c-bee3-3f183d47bc7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.307436 Sep 12 14:15:33.739180 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:33 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:33.872489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-473706465", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9236f9c0-b543-4fbe-9872-2a3e0012862d"}], "security_groups": [{"name": "tempest-securitygroup--1029981992"}], "key_name": "tempest-keypair-2126430200", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:33.876837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.885494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.887192 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:33.888516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4579cbd1-abe2-41b0-a0b5-ca758458079a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.189379 Sep 12 14:15:33.889237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 149/296] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:33 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:34.019694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] validate_networks() for [('9236f9c0-b543-4fbe-9872-2a3e0012862d', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:15:34.267281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:34.269405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:34.281333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.282207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.283746 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.284723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.285743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.286420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.492373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:15:34.492879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:15:34.493425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:15:34.493959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:15:34.494442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:15:34.507446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.508011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.508515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.509318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.509841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.510570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.517578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:34.529288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-aa5688b0-0978-43ea-9883-947e8050eeb9 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.267613 Sep 12 14:15:34.542107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 150/297] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:34 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:34.542256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:15:34.542256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:15:34.552471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:15:34.554983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:15:34.575604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:34.605337 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80807410-f279-4717-ab4c-83aa462fe87b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.740047 Sep 12 14:15:34.606130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 148/298] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:15:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:15:34.617568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5261b694-eeeb-4de9-a77b-7eeec74af4e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:34.618271 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5261b694-eeeb-4de9-a77b-7eeec74af4e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:34.694702 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:34.695697 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:34.705292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5261b694-eeeb-4de9-a77b-7eeec74af4e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:34.711433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.713110 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5261b694-eeeb-4de9-a77b-7eeec74af4e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1241 microversion: 2.1 time: 0.099572 Sep 12 14:15:34.714691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.715539 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.718330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.719383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.720341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.727166 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 151/299] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:34 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:34.768549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:34.769502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:34.779146 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.779636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.780098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:34.780795 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:34.781257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:34.781674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.018363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.026504 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-209cfab7-c019-467f-8b5d-446c005c9a74 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1507 microversion: 2.1 time: 0.336616 Sep 12 14:15:35.027164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 149/300] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:34 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:35.031632 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:35.032239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:35.038172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.038660 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.039293 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.040152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.040612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.041051 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.059971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.071466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d7d07c21-9440-47fb-83dd-1e596e6e36ba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.307268 Sep 12 14:15:35.071971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 152/301] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:34 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:35.199043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.208182 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.209778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.212350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01a5efed-c632-459d-b204-4ed5e5cdd85f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.183025 Sep 12 14:15:35.212350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 150/302] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:35 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:35.557490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:35.558185 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:35.565038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.565344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.565768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.566441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.566967 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.567530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.697157 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.705596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3b239fc0-ce9f-4fe9-8e66-a26e353726bd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.151873 Sep 12 14:15:35.706513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 153/303] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:35 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:35.739145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:35.739868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:35.745802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.746398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.746826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.747677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:35.748125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:35.748539 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:35.817214 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:35.825137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b894da2-0292-46d0-9118-d186be45682c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1293 microversion: 2.1 time: 0.090981 Sep 12 14:15:35.825703 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 151/304] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:35 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:36.096852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:36.097617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:36.113284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.114117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.114657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.115500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.116330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.116968 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.240511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:36.241746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:36.251332 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.252014 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.252667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.253400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.253891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.254362 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.372663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:36.387493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f915ff9-fc34-45a0-88ee-a8df9b3834e9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.292747 Sep 12 14:15:36.404364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 154/305] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:36 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:36.411089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "name": "network-vif-plugged", "status": "completed", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:36.423893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.424802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.425241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.439955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] Creating event network-vif-plugged:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:15:36.445750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:36.453615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-afde3c23-e061-4f35-a6b7-ab65a876d35c req-2d7a8926-d4f2-4917-9e93-ab616d3f0a8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047841 Sep 12 14:15:36.454214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 155/306] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:36.456265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:36.458009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:36.459248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d658f7bb-d1e1-48dd-96f9-65523ace39c4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.226713 Sep 12 14:15:36.459795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 152/307] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:36 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:36.734151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:36.734875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:36.741647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.742132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.742564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.743295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.745417 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.745859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.848798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:36.849685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:36.855583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.856065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.856496 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.857191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:36.857643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:36.858065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:36.892410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:36.894945 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:36.907835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-66640b91-18e9-499d-8e9e-e969a24a4caf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.178310 Sep 12 14:15:36.917938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 156/308] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:36 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:37.000969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:37.008772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0b5ef53-0b77-4f79-8d21-1fb72405a419 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.163950 Sep 12 14:15:37.009338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 153/309] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:36 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:37.414183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:37.414785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:37.420972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.421445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.421870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:37.422947 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.423809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.424321 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:37.486268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:37.487122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:37.493352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.494501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.495337 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:37.495665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.496127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.496581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:37.603343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:37.613098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-16132df7-e14b-4665-a0c8-7ff3e21a0916 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.202631 Sep 12 14:15:37.613905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 157/310] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:37 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:37.647654 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:37.656720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:37.658099 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:37.659350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5d5e8110-cf87-4cc8-906a-b3d7b28a7f3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.177056 Sep 12 14:15:37.659911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 154/311] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:37 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:37.932516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:37.933159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:37.940685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.941174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.941609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:37.942295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:37.942748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:37.943196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.031825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:38.033666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:38.039866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.040349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.040775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.041469 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.041919 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.042335 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.081373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:38.091499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7c26fba8-c28a-4ad1-a0a0-d7b6472241c6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.162839 Sep 12 14:15:38.092001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 158/312] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:37 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:38.177544 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:38.185368 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7ee9ff0-9ef4-4d34-b76a-b431456b3bc9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.157333 Sep 12 14:15:38.185938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 155/313] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:38 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:38.636474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:38.637313 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:38.643996 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.644474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.644976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.645748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.646242 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.646723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.683635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:38.684364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:38.691336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.691920 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.692408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.693200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:38.693730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:38.694226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:38.709884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:39.058476 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.068004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-06cb5c9a-09cb-4947-ada3-b548d7bdda1d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.435357 Sep 12 14:15:39.068587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 159/314] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:38 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:39.087803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.097694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.099168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.100357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fde96ac3-7ddc-45da-a29a-86aba6b17901 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.420575 Sep 12 14:15:39.100924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 156/315] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:38 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:39.113937 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:39.114546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:39.120485 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:39.120960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:39.121389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:39.122070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:39.122525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:39.122980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:39.208738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:39.209343 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:39.215731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:39.216209 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:39.216636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:39.217322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:39.217768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:39.218185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:39.250741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.259159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4420c96c-3e5b-4783-84d1-cb59ea8f324c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.149580 Sep 12 14:15:39.259734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 160/316] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:39 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:39.347684 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:39.355222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5dd4db9-b4fa-4de5-87b4-750a4982a298 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.150233 Sep 12 14:15:39.355785 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 157/317] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:39 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:40.090780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:40.091434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:40.097717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.098198 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.098630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.099349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.099802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.100223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.126355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:40.127116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:40.134602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.135643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.136279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.138170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.138942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.139850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.295983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.304205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-92f7ee37-1dda-4720-a1d7-6d3b3e61211d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.217328 Sep 12 14:15:40.304771 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 161/318] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:40 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:40.309858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d0572f-025c-430b-87d7-83f02ec83568", "tag": "11973ac5-af69-497e-8b4e-7b63054c309b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:40.320654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.321126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.321544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.327153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.332688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] Creating event network-changed:11973ac5-af69-497e-8b4e-7b63054c309b for instance c4d0572f-025c-430b-87d7-83f02ec83568 on hv-cinder-82002 Sep 12 14:15:40.336206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.337431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-073c1320-ce8e-4816-8fbf-4e729fd836f3 req-88c87a54-3d3d-467a-b975-2d08bfeb6065 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Sep 12 14:15:40.337852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.338011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 162/319] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:40.339280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26ccbd21-77d8-42d9-b338-4b2d7ffe8367 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.217380 Sep 12 14:15:40.340066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 158/320] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:40 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:40.344153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:40.344917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:40.351668 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.352094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.352526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.353231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.353683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.354103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.379418 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:40.380118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:40.386212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.386880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.387336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.388039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:40.388496 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:40.388922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:40.548340 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.575796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ced684ce-db2b-45c9-a40c-90a7e2f11226 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.236427 Sep 12 14:15:40.579107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 163/321] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:40 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:40.579807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:40.588448 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a075838-c58e-42ac-97f5-edb602c0f085 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.213374 Sep 12 14:15:40.589068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 159/322] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:40 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:41.327806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:41.328394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:41.335558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.336033 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.336463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.337648 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.338529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.338991 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.364934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:41.365569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:41.371528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.372009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.372462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.373190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.373623 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.374023 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.529900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.538026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0854aa7c-7737-4392-aa3f-879dd7f069e2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.214037 Sep 12 14:15:41.538594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:41 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:41.546387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.555026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.556458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.557598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0c4b021b-e0f2-4471-bd08-1ec16538eaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.197244 Sep 12 14:15:41.558151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 160/324] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:41 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:41.606870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:41.607636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:41.612140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:41.612773 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:41.613603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.614085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.614525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.615243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.615695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.616117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.618637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.619294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.619612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.620306 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:41.620758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:41.621598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:41.809388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.814775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:41.819487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d044f20b-ad1a-436e-ab9f-d5efcaa55f31 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.216470 Sep 12 14:15:41.826994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 165/325] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:41 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:41.831826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5a03b10-c37c-4de2-a22f-65faa097b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.223443 Sep 12 14:15:41.832555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 161/326] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:41 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:42.561067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:42.561656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:42.568674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.569116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.569757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.570829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.571372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.571979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.583845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:42.584470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:42.590336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.590816 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.591280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.591973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.592429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.592855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.774346 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:42.777739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:42.782080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4f2979e9-43b0-4558-9049-231ba1b1e8dc tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.224850 Sep 12 14:15:42.783253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 166/327] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:42 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:42.786386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:42.787850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:42.789004 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94c27a99-2441-47fc-86f4-c7cdba3a0508 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.209636 Sep 12 14:15:42.789543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 162/328] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:42 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:42.842114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:42.842728 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:42.848664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.849239 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.849577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.850263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.850724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.851165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.854482 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:42.855347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:42.863173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.863657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.864080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:42.864772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:42.865228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:42.865646 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:43.056072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:43.060115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:43.065212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-da478f6a-e63f-4a4a-968f-3c879bfa4a12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.226853 Sep 12 14:15:43.065781 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 167/329] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:42 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:43.068899 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70733baa-3f50-4e6f-b1b7-c5254eb49e34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.218580 Sep 12 14:15:43.069456 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 163/330] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:42 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:43.809056 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:43.809655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:43.813576 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:43.814203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:43.822451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:43.822451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:43.822451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:43.822451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:43.822954 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:43.823046 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:43.823148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:43.823238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:43.823324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:43.823324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:43.823324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:43.823324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:44.021132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.027687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.028758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95476197-447d-4ed0-9a21-7c811e183b02 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.223551 Sep 12 14:15:44.029339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 168/331] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:43 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:44.035731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.037173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.038327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e57ae607-680d-4214-83d2-dfa08012e5e6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.228868 Sep 12 14:15:44.038885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 164/332] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:43 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:44.089144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:44.089756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:44.093194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:44.093809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:44.095832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:44.096885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:44.097362 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:44.098099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:44.098594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:44.099049 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:44.100288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:44.100761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:44.101195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:44.102081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:44.102538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:44.103001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:44.293038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.296080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:44.303194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cee195c5-0ee7-421e-97d8-ded0247d2027 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.218037 Sep 12 14:15:44.303763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 169/333] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:44 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:44.303965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7051139-b6a4-4d46-ae99-749618326223 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.214464 Sep 12 14:15:44.304607 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 165/334] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:44 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:45.051535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:45.052142 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:45.054051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=14 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:45.060420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.060898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.061319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.062022 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.062474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.062918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.063206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:45.064074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:45.065934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:45.066635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:45.073007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.073007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.073313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.073994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.074443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.075042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.263150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.265977 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.271464 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7f12beda-0d09-40f6-ab1e-ac244f2cfe7f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1367 microversion: 2.1 time: 0.224448 Sep 12 14:15:45.272256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 170/335] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:45 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:45.274827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.276315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.277455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c21464c-d6f0-4ff9-b6cd-1df466ab5709 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.218087 Sep 12 14:15:45.277997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 166/336] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:45 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:45.327483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:45.327687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:45.328122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:45.328231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:45.334403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.334918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.335393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.335726 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.336093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.336277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.336542 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.336860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.336981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.337733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:45.338189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:45.338613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:45.532368 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.536964 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:45.540828 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdc04d89-b4b6-4331-835e-d422be4edc76 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.217133 Sep 12 14:15:45.541484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 167/337] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:45 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:45.545182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dc746166-f2f2-4efd-a3ef-5556a73fda28 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.221660 Sep 12 14:15:45.545744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 171/338] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:45 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:46.294333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:46.294991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:46.300971 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.301688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.301876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:46.302278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.302487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:46.302640 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.303115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.303534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.304333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:46.309472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.309950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.311270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.311969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.312428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.312853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.501593 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.505391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.510106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fad853f-b056-4bd1-a06a-15bab6707b38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1560 microversion: 2.1 time: 0.219607 Sep 12 14:15:46.510674 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 168/339] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:46 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:46.513589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.515069 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.516222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4e3bf133-f5a3-450e-8ed0-08768be03fae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.218756 Sep 12 14:15:46.516768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 172/340] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:46 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:15:46.531848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:46.532334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:46.538556 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.539069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.539496 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.540165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.540610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.541024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.563643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:46.564256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:46.571272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.571803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.572329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.573060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.573516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.573942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.618831 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b11fd832-2ce0-494e-adf6-53c276f962cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090571 Sep 12 14:15:46.619570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:15:46 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:46.624206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:46.625062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:46.631275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.631769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.632206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.632904 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:46.633386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:46.633818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:46.776813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.786067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5f2ccd32-5943-4aad-bb00-16fbb85e0b11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.226484 Sep 12 14:15:46.786830 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 173/342] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:46 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:46.808848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:46.818029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ad82738-53ec-4664-9ab8-2cacdb727931 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.197404 Sep 12 14:15:46.818791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 170/343] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:46 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:47.541608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:47.542439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:47.548997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.549558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.550658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.551375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.551834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.552426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.556447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:47.686086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:47.695139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:47.696564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:47.697717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8e9afa3f-1fec-4315-8612-309d15e943b6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.160191 Sep 12 14:15:47.698267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 174/344] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:47 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:47.808803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:47.809426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:47.811368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:47.817412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.817907 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.818347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.819079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.819541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.819965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.835322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.835322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.835322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.843752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] Creating event network-changed:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:15:47.852069 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-18f0fa71-fe15-42f2-8fa5-8f57a6cd32fd req-48d2a41d-1ea1-4be7-8eac-0b1597e59636 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044577 Sep 12 14:15:47.852861 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 175/345] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:15:47.859553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:47.860248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:47.866938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.867421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.867864 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:47.868703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:47.869183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:47.869601 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:48.041997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:48.049508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:48.050511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25bee6b6-254a-496e-9b19-e995a242ff13 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.244764 Sep 12 14:15:48.051231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 171/346] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:47 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:48.058815 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-af2d78c8-dd44-4b20-a310-b4565631d14e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.204033 Sep 12 14:15:48.059337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 176/347] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:47 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:48.722749 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:48.723420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:48.732650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:48.733149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:48.733586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:48.734296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:48.734750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:48.735200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:48.924263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:48.933432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:48.934908 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:48.936104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ceb529fe-3759-4dbb-a8d7-f70aee772283 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.217469 Sep 12 14:15:48.936659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 172/348] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:48 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:49.074423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:49.075077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:49.082609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.083234 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.083672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:49.085096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:49.085253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.085812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.086221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:49.086339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:49.093254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.093742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.094203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:49.094898 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.095358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.095780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:49.113071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:15:49.296123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:49.299316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:49.304609 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-90dfaa56-951f-4f3b-bf69-8d6b1c620385 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.234763 Sep 12 14:15:49.305582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 177/349] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:49 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:49.308915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a5e549d-a004-44e2-af58-fd282adbd6b4 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.228637 Sep 12 14:15:49.309612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 173/350] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:49 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:49.962343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:49.962926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:49.968850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.969322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.969748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:49.970421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:49.970899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:49.971354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:50.100515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:50.109698 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:50.111298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:50.113074 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c77815e8-4259-4ccd-ac75-f9ca01417519 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.154184 Sep 12 14:15:50.113702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 178/351] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:49 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:50.328161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:50.329395 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:50.333670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:50.334549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:50.336119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:50.336520 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:50.336948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:50.337649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:50.338294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:50.338719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:50.340863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:50.341343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:50.341773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:50.342510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:50.342983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:50.343405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:50.531669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:50.535796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:50.539807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bb26020-bcf5-461e-8119-1630d4d7bda9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.215580 Sep 12 14:15:50.540379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 174/352] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:50 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:50.543867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-625a16a8-1930-4c9c-ae25-9fdebe8aee55 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1724 microversion: 2.1 time: 0.214489 Sep 12 14:15:50.544431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 179/353] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:50 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:51.138559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:51.139116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:51.145325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.145848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.146275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.146981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.147435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.147852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.276028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:51.284691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:51.286128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:51.287364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4dd56fc5-df77-421d-b806-f13908473b30 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1743 microversion: 2.20 time: 0.152813 Sep 12 14:15:51.287923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 175/354] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:51 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:51.563713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:51.565004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:51.568531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:51.569719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:51.573575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.574154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.574673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.575711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.576326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.576650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.576907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.577398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.577897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.578655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.579194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.579803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.774425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:51.777616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:51.783604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb9586eb-0431-413e-989f-35bae7b32954 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1701 microversion: 2.1 time: 0.220342 Sep 12 14:15:51.785041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 176/355] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:51 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1701 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:51.786053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a9765c8-1e01-4bb5-9a87-9918c4a7f831 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.226497 Sep 12 14:15:51.786617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 180/356] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:51 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:51.809428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:51.815952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.816440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.816881 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.839761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Going to try to start instance {{(pid=120625) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 14:15:51.881151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3cdf20a-e3fe-486c-98f6-e64219940c66 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action" status: 202 len: 0 microversion: 2.1 time: 0.075617 Sep 12 14:15:51.881752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 177/357] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:15:51 2022] POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:15:51.889926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:51.890539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:51.896563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.897042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.897473 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:51.898177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:51.898663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:51.899121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:52.063982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:52.072546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-228bfcdc-48da-470d-901d-74dbaa5ecf9b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1710 microversion: 2.1 time: 0.186397 Sep 12 14:15:52.073147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 181/358] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:51 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:52.314653 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:52.316107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:52.322874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:52.323492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:52.324148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:52.324957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:52.325538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:52.326326 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:52.736924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:52.747015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:52.748451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:52.749739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4de3469b-1345-47a6-b4fc-d7402ea88389 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1743 microversion: 2.20 time: 0.439786 Sep 12 14:15:52.750578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 178/359] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:52 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1743 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:52.810177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:52.811889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:52.819434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:52.819921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:52.820362 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:52.821058 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:52.821509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:52.821934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:52.953892 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:52.962086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-63cd7b18-ceb5-4f09-97b2-12f8849610d7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.156868 Sep 12 14:15:52.962648 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 182/360] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:52 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:53.097338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:53.097990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:53.104177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.104699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.105241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.106006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.106461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.106981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.240130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:53.248421 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74ee73e4-ff73-4a24-8c9b-7fe75ceae117 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1710 microversion: 2.1 time: 0.156101 Sep 12 14:15:53.248989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 179/361] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:53 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:53.701690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "name": "network-vif-plugged", "status": "completed", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:53.712178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.712673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.713077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.724924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] Creating event network-vif-plugged:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:15:53.729881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-71be6ecb-db66-40c5-9cc2-ec44316bb96d req-6b9ce93b-c76c-47f5-9d98-5b1a8ffb28fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Sep 12 14:15:53.730449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 183/362] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:15:53.775790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:53.776423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:53.782174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.782650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.783114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.783804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.784784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.785218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.926956 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:53.936685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:53.937217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:53.938879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57703117-f0ec-4ef1-9197-d99069884868 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1743 microversion: 2.20 time: 0.167054 Sep 12 14:15:53.939442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 180/363] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:53 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:53.986429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:53.987650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:53.997184 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.997687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.998132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:53.998820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:53.999357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:53.999769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.123801 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:54.131817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40c0c773-462c-4ff1-a185-020812a74bc3 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.150032 Sep 12 14:15:54.132394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 184/364] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:53 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:54.273317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:54.274029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:54.280044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.280521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.280984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.281735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.282189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.282658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.418473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:54.427355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7c94e91-0097-44ad-ab2b-bfe4f9ba3565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1710 microversion: 2.1 time: 0.157786 Sep 12 14:15:54.428155 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 181/365] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:54 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:54.522115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf7ac58b-afb2-4d20-9e24-f326a7cfd36e", "device": "/dev/sdb"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:54.525050 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:54.531123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.531607 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.532062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.532872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.533360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.533843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.894416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6f7dface-84d8-428e-bd51-44759e21b867 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "POST /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377331 Sep 12 14:15:54.895169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 185/366] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:15:54 2022] POST /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:54.966730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:54.967361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:54.975093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.975578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.976008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:54.976702 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:54.977149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:54.977567 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.126826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:55.135383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:55.136912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:55.138207 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8161dc2d-e3b1-40b4-a457-494c82c16bff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1743 microversion: 2.20 time: 0.175503 Sep 12 14:15:55.138866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 182/367] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:54 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:55.156123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:55.156913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:55.164199 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:55.164681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:55.165235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.166016 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:55.166434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:55.166885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.301462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:55.312043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0924f857-2c06-4f39-a090-5103560ac8b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.160838 Sep 12 14:15:55.312603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 186/368] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:55 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:55.450008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:55.450551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:55.456914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:55.457397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:55.457831 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.458516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:55.459031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:55.459519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.609570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:55.618583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e93f9ddf-1cff-4bd2-88c0-57c74b4ac565 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1714 microversion: 2.1 time: 0.172436 Sep 12 14:15:55.619184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 183/369] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:55 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1714 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:55.755579 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d0572f-025c-430b-87d7-83f02ec83568", "name": "network-vif-plugged", "status": "completed", "tag": "11973ac5-af69-497e-8b4e-7b63054c309b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:15:55.766527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:55.767331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:55.767975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:55.783412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] Creating event network-vif-plugged:11973ac5-af69-497e-8b4e-7b63054c309b for instance c4d0572f-025c-430b-87d7-83f02ec83568 on hv-cinder-82002 Sep 12 14:15:55.790338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-21593d75-6218-4478-a8e9-1bc8e7e023a1 req-badb130f-0381-4239-807d-c6633642efcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039720 Sep 12 14:15:55.791222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 187/370] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:15:56.165740 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:56.167293 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:56.176453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:56.176957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:56.177407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:56.178075 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:56.178530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:56.179202 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:56.337487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:56.338198 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:56.345497 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:56.346249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:56.347487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:56.348418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:56.349094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:56.349739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:56.386735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:56.397570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:56.399062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:56.400209 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb668121-cd09-49e1-b4f6-95b8d6d5039a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.240417 Sep 12 14:15:56.400792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 184/371] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:56 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:56.548574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:56.558255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-48de50b3-7dd4-490c-ab59-22b01a0d8d8d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.225325 Sep 12 14:15:56.562082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 188/372] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:56 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:57.427298 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:57.428019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:57.441043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:57.441534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:57.442253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:57.442970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:57.455723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:57.456448 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:57.590560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:57.591865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:57.603582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:57.606180 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:57.607470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:57.608183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:57.608649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:57.609080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:57.847009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:57.865136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:57.868161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:57.869658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ad9380a-26c5-4eec-90c7-9019c3fc8ed9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.446753 Sep 12 14:15:57.887301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 185/373] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:57 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:57.891285 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:57.899565 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7f41aff1-f148-4db3-8f78-24a140aa14d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1367 microversion: 2.1 time: 0.312686 Sep 12 14:15:57.900695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 189/374] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:57 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:15:58.895173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:58.896447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:58.904755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:58.908570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:58.909591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:58.911332 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:58.911994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:58.912591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:58.935086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:58.936605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:58.948355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:58.952866 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:58.953963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:58.954967 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:58.955702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:58.956523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:59.186694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:59.202106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:59.218820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:59.220665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce46afdc-efe4-4fe1-b960-8a6e9dd4f22e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.329678 Sep 12 14:15:59.223242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 186/375] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:15:58 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:15:59.280599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:15:59.290742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ba26c9a-db0e-4d04-8a1e-1efe332991fc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1557 microversion: 2.1 time: 0.364406 Sep 12 14:15:59.292163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 190/376] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:15:58 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1557 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:15:59.319597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:15:59.320097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:15:59.330571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:59.331186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:59.333662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:59.335881 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:15:59.338803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:15:59.339512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:15:59.464558 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f62ab441-d1ca-4654-8e5c-dc7c1a65a8f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149817 Sep 12 14:15:59.465573 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 187/377] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:15:59 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:00.249085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:00.250390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:00.263924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:00.268909 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:00.269599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:00.270582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:00.271502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:00.272195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:00.318909 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:00.652658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:00.661395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:00.668933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:00.671975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-239f29ec-2f74-43f0-9a4a-4ab653742d93 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.426919 Sep 12 14:16:00.683510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 191/378] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:00 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:01.208174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d0572f-025c-430b-87d7-83f02ec83568", "tag": "11973ac5-af69-497e-8b4e-7b63054c309b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:01.234629 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:01.236375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:01.237342 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:01.257967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] Creating event network-changed:11973ac5-af69-497e-8b4e-7b63054c309b for instance c4d0572f-025c-430b-87d7-83f02ec83568 on hv-cinder-82002 Sep 12 14:16:01.264557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-43c8c839-536e-4a33-9753-b16f77f461e8 req-2a0da61a-09d5-4ca6-b7a5-aec1fb4c1341 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066876 Sep 12 14:16:01.270534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 188/379] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:01.699677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:01.700980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:01.714434 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:01.727278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:01.727983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:01.729201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:01.729837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:01.730413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:02.308052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:02.317749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:02.319762 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:02.321125 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c0b89f55-291c-4e81-b8a5-bcc7b3a551d0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.625313 Sep 12 14:16:02.347792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 192/380] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:01 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:03.355761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:03.356457 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:03.373371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:03.373874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:03.374311 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:03.375045 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:03.375497 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:03.375914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:03.710313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:03.721148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:03.724021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:03.725670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4c7d861-3ee5-4543-99ab-0c2d1a1d5e00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.374413 Sep 12 14:16:03.726483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 189/381] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:03 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:04.753080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:04.754403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:04.763875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:04.768798 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:04.772734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:04.773546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:04.774113 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:04.777317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:05.099734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:05.113027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:05.116328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:05.123020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b77d5c23-1473-479c-816c-d727366ea82a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.372163 Sep 12 14:16:05.123854 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 193/382] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:04 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:06.155907 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:06.157730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:06.161583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:06.166525 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:06.167470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:06.168296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:06.169260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:06.169971 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:06.171042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:06.193073 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:06.519148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:06.531893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:06.541834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:06.544358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df469eaa-5262-4007-8815-72e0852a5550 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.392850 Sep 12 14:16:06.546398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 190/383] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:06 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:07.569787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:07.571107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:07.584571 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:07.585602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:07.599043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:07.600295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:07.602457 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:07.603118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:08.049094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:08.069124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:08.078589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:08.087914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1c9cd88e-2557-423d-abe8-b1b17cb81880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.521755 Sep 12 14:16:08.093314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 194/384] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:07 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:09.117887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:09.118486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:09.133538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:09.134029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:09.134463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:09.140385 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:09.140696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:09.141134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:09.428626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:09.441757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:09.444676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:09.448840 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f7c2d82-6b22-4d14-93c8-ba1584e93583 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.334810 Sep 12 14:16:09.449408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 191/385] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:09 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:10.492665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:10.493983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:10.523535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:10.527642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:10.528345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:10.529257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:10.529871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:10.530818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:10.934226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:10.953377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:10.955122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:10.959375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6556abe8-d62a-4381-a52f-1ec47a86eed6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.470660 Sep 12 14:16:10.960480 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 195/386] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:10 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:11.984777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:11.985394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:12.003195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:12.003674 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:12.004307 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:12.006635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:12.007409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:12.008156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:12.269196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:12.304505 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:12.306630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:12.308725 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42b1ef21-946f-4dd2-82da-019a2e369c9a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.327573 Sep 12 14:16:12.328401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 192/387] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:11 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:13.335789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:13.337318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:13.343774 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:13.344253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:13.344684 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:13.345380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:13.346490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:13.354877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:13.493277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:13.503183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:13.504936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:13.506336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cdcfaa95-f816-4dce-b00f-8bc8e5050018 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.175961 Sep 12 14:16:13.507213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 196/388] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:13 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:14.533778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:14.535328 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:14.541708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:14.542513 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:14.543221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:14.544272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:14.545272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:14.545933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:14.712461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:14.723711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:14.725316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:14.726550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7324fe08-c62d-42de-b226-35655a1416b1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.197459 Sep 12 14:16:14.727372 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 193/389] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:14 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:15.757717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:15.759063 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:15.771939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:15.774172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:15.774804 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:15.775992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:15.776632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:15.777327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:15.926972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:15.938312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:15.939959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:15.941138 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8a03f5f0-20ce-4736-b6e7-22146836347c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1738 microversion: 2.20 time: 0.187343 Sep 12 14:16:15.941698 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 197/390] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:15 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:16.967982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:16.968709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:16.976268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:16.976783 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:16.977221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:16.977908 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:16.978362 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:16.978784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:17.123565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:17.132578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:17.134321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:17.135849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cab82d9e-e671-4d76-940f-111024ebd244 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1720 microversion: 2.20 time: 0.172128 Sep 12 14:16:17.155198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 194/391] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:16 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:18.163182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:18.164501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:18.167118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=52 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:18.172471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:18.172949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:18.173372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:18.174613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:18.176162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:18.176162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:18.340835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:18.350236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:18.351914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:18.353279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-17907bd7-5408-43c1-8758-91899cd7e405 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1720 microversion: 2.20 time: 0.194285 Sep 12 14:16:18.361829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 198/392] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:18 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:19.380315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:19.381756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:19.388435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:19.389319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:19.390257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:19.391005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:19.391560 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:19.391983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:19.580356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:19.589154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:19.590588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:19.591761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82cb757f-866f-4cfc-97cc-209f11ddef50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1720 microversion: 2.20 time: 0.216192 Sep 12 14:16:19.592352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 195/393] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:19 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:19.803327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "name": "network-vif-unplugged", "status": "completed", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:19.815656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:19.816369 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:19.817040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:19.832531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] Creating event network-vif-unplugged:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:16:19.840528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-70f00c53-c85f-46f5-8f0a-ea0248414e29 req-b9992ef2-0c43-4dc2-a5c1-1360f79b0ee6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041611 Sep 12 14:16:19.841513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 199/394] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:19.965915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:19.966606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:19.973785 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:19.974268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:19.974697 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:19.975404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:19.976008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:19.976606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.109843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lazy-loading 'services' on Instance uuid 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:16:20.156842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2398c76c-baf7-43e2-9e3b-bd633a62b735 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'create', calling method: .version_select at 0x7f7560e2a040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1727228308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmKC5Rj4+OsYQhJD8UzTnUUweaqQ2X3LSunct+XNLbLM5WJXdm6FHbZZywGyfEcZAZSQ2OApm8o6ywkneyPMtPJwEr+xcBhMRlSa0jUHIywfrIxKVJpZni7fk9aX4vZlg=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:20.172858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-2398c76c-baf7-43e2-9e3b-bd633a62b735 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Getting quotas for project 40918a5eb3134a00999618cb65dedbbd. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:16:20.177003 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-2398c76c-baf7-43e2-9e3b-bd633a62b735 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Getting quotas for user 67c00c7b37ba44aa9ca0e4555d32ec90 and project 40918a5eb3134a00999618cb65dedbbd. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:16:20.199861 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2398c76c-baf7-43e2-9e3b-bd633a62b735 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047193 Sep 12 14:16:20.200692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 200/395] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:16:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:16:20.224759 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b61375c9-178f-4b66-a042-94efc07c5b20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6/os-volume_attachments/cf7ac58b-afb2-4d20-9e24-f326a7cfd36e" status: 202 len: 0 microversion: 2.1 time: 0.262516 Sep 12 14:16:20.225356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 196/396] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:16:19 2022] DELETE /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6/os-volume_attachments/cf7ac58b-afb2-4d20-9e24-f326a7cfd36e => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:16:20.255493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1879636570", "imageRef": "ab2a61b7-fe42-4f8b-89b9-5c7e613166a3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1727228308", "networks": [{"uuid": "c4f97835-1b03-495e-a09a-05ede27a9ab6"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:20.305794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] validate_networks() for [('c4f97835-1b03-495e-a09a-05ede27a9ab6', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:16:20.622011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:20.622824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:20.629490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.629972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.630404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.631113 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.631564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.631983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.738753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:16:20.739246 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:16:20.739717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:16:20.740118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:16:20.740520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:16:20.749175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.749647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.750073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.750783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.751259 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.752279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.768439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Getting quotas for project 40918a5eb3134a00999618cb65dedbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:16:20.772364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Getting quotas for user 67c00c7b37ba44aa9ca0e4555d32ec90 and project 40918a5eb3134a00999618cb65dedbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:16:20.783177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:16:20.783699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:20.785498 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab2a61b7-fe42-4f8b-89b9-5c7e613166a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:16:20.791879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:20.793321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:20.794605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-223e259c-b9cc-494f-b96d-17256935aca4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1723 microversion: 2.20 time: 0.176842 Sep 12 14:16:20.795226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 197/397] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:20 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:20.821364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68b257bd-3a0b-4361-8269-f72679b5eb82"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:20.824196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:20.837221 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0dc01fbb-1f5a-4e79-b9f2-3afa21c9fc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586040 Sep 12 14:16:20.838982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 201/398] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:16:20.851180 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.851776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4f3dcd68-769c-4e0d-b70d-f4091e90c055 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:20.852903 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4f3dcd68-769c-4e0d-b70d-f4091e90c055 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:20.855445 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.856058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.857220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:20.857778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:20.858469 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:20.922940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f3dcd68-769c-4e0d-b70d-f4091e90c055 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:20.940136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4f3dcd68-769c-4e0d-b70d-f4091e90c055 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1259 microversion: 2.1 time: 0.094426 Sep 12 14:16:20.951949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 202/399] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:20 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1259 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:21.254987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f971c15-16be-4374-8a31-78e64465cba1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.437539 Sep 12 14:16:21.260959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 198/400] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Sep 12 14:16:20 2022] POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments => generated 188 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:16:21.423101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:21.424014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:21.430334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.430819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.431335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:21.432056 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.432509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.432929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:21.475500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120624) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 14:16:21.546089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0de1eb38-0b19-4db6-a870-74dae7ef9ae9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/action" status: 202 len: 0 microversion: 2.20 time: 0.126911 Sep 12 14:16:21.546860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 203/401] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 12 14:16:21 2022] POST /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:16:21.555129 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:21.555748 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:21.561626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.562107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.562550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:21.563529 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.563986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.564486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:21.794670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:21.803537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:21.805619 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:21.806177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5fb86ba-ce0c-42a5-a848-267ae52d3434 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1809 microversion: 2.20 time: 0.255072 Sep 12 14:16:21.806731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 199/402] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:21 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:21.968079 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:21.969821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:21.978562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.979374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.979836 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:21.980535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:21.980978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:21.981392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.071039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:22.079098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d875ca83-42a4-4e70-9751-132d340ea2a6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1311 microversion: 2.1 time: 0.118471 Sep 12 14:16:22.080651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 204/403] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:21 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:22.424089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:22.424583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:22.430487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.430993 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.431429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.432108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.432558 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.432982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.459603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:16:22.536594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2144e16a-08b8-45e2-8f8c-5a43fc878a26 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 204 len: 0 microversion: 2.1 time: 0.116518 Sep 12 14:16:22.537336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 200/404] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:16:22 2022] DELETE /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:16:22.545530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:22.546260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:22.560527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.561023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.561458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.562165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.562621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.563331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.694898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:22.702687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0e980b9a-ba62-40a3-9d35-4175e3001583 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1513 microversion: 2.1 time: 0.161125 Sep 12 14:16:22.703268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 205/405] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:22 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:22.835909 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:22.836601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:22.842416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.842919 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.843351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.844038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:22.844473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:22.844893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:22.973273 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:22.976108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:22.983880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:22.985318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:22.986471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0c91970-6de3-4570-979d-9a852a8b0683 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1749 microversion: 2.20 time: 0.154841 Sep 12 14:16:22.987065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 201/406] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:22 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:23.103312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:23.103916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:23.110202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:23.110676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:23.111133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:23.111806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:23.112250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:23.112664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:23.172350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:23.179908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a4f987e7-3664-4866-b6ce-0c9fa1795945 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1319 microversion: 2.1 time: 0.080285 Sep 12 14:16:23.180398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 206/407] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:23 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1319 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:23.725999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:23.726607 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:23.733063 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:23.733538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:23.733969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:23.734651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:23.735130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:23.735552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:23.865994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:23.873596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab8e98df-ec57-42eb-83c2-0e1db972ec22 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1513 microversion: 2.1 time: 0.152025 Sep 12 14:16:23.874161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 202/408] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:23 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:24.011505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:24.012109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:24.017931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.018402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.018832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:24.019525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.019973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.020389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:24.144404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:24.152820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:24.154236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:24.155406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bc9670ed-788f-4b9d-b74b-7aac49899f33 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1749 microversion: 2.20 time: 0.147837 Sep 12 14:16:24.155957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 207/409] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:24 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1749 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:24.201788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:24.202396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:24.208173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.208652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.209084 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:24.209765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.210212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.210630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:24.268940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:24.276597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f1bc208-b2ab-48aa-85fd-5e3b2c690a28 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1319 microversion: 2.1 time: 0.078597 Sep 12 14:16:24.277156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 203/410] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:24 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1319 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:24.899930 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:24.901094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:24.910202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.911056 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.911744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:24.912743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:24.913190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:24.914796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.120877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:25.130155 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2c8515b8-d6bc-4655-be1d-020fff871920 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1513 microversion: 2.1 time: 0.235547 Sep 12 14:16:25.132986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 208/411] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:24 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:25.184359 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:25.186277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:25.207235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:25.208281 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:25.213470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.214551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:25.215249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:25.215870 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.300034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:25.301231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:25.322449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:25.326796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:25.327932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.335264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:25.338891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:25.341545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.785065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:25.803694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:25.803694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:25.805663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:25.806474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c8ed712-8145-47e6-98d5-74d9b6a0a970 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.629091 Sep 12 14:16:25.807283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 204/412] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:25 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:25.813279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673ee208-578b-46e3-b4e0-ebd0ad4f57d6", "name": "network-vif-deleted", "tag": "47d4c7fb-4320-44f1-8f93-b2a672d8d322"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:25.836068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:25.836800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:25.837589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:25.849576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7d570921-73d0-415d-b94a-31922fdcb887 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.553783 Sep 12 14:16:25.850681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 209/413] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:25 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:25.862382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] Creating event network-vif-deleted:47d4c7fb-4320-44f1-8f93-b2a672d8d322 for instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 on hv-cinder-82002 Sep 12 14:16:25.868408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-47126caf-800b-44c1-95f4-f6a4f48fb240 req-8b48f6f7-538a-4698-a798-e9b325e3f955 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059785 Sep 12 14:16:25.869578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 205/414] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:26.160055 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:26.160666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:26.167168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.167690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.168121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:26.168783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.169239 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.169646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:26.191848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:26.241688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:26.249554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f95a0589-b201-4e8c-a67a-08d5c0be086e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.093391 Sep 12 14:16:26.250118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 210/415] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:26 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:26.840060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:26.840756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:26.847495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.848011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.848449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:26.849127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.849574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.849988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:26.875333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:26.876843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:26.883939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.884731 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.885385 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:26.886435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:26.887147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:26.887823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:27.048001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:27.058442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:27.060981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:27.063221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8580a90e-0e9f-4988-9267-98e5ad0758e9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.226585 Sep 12 14:16:27.064565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 206/416] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:26 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:27.078228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:27.087374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2f6e0f52-fdbb-4029-863f-6aa805b99225 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.216692 Sep 12 14:16:27.087874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 211/417] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:26 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:27.275407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:27.275936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:27.282398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:27.283006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:27.283393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:27.284097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:27.284561 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:27.284988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:27.349218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:27.357550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc101c97-ce0b-47bd-b156-1dbf14461cd4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.086039 Sep 12 14:16:27.358401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 207/418] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:27 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:28.094207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:28.094953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:28.102557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.103065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.103591 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.105649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.105649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.105649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.111511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:28.112974 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:28.119386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.120145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.120826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.123407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.123897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.125015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.325599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:28.336019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:28.337667 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:28.339015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-95f16cdb-5122-45d3-a220-f30892a6db3f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.248913 Sep 12 14:16:28.343318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 212/419] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:28 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:28.359543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:28.367397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82c3e339-88e8-45b1-9daa-82a9fdfa7aac tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.260137 Sep 12 14:16:28.368196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 208/420] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:28 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:28.381127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:28.381744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:28.388216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.388703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.389135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.389828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:28.390281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:28.390701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:28.457295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:28.464716 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b0c24304-d059-4f1f-8fb6-734dfd1ddf65 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.087401 Sep 12 14:16:28.466326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 213/421] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:28 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:29.364574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:29.365243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:29.373107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.373600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.374028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.374775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.375367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.375789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.389611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:29.390226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:29.396779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.397263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.397780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.398481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.400042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.400490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.610046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:29.621714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:29.623224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:29.624383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-125b993d-562e-4ce3-bb19-0fbbe89e3d26 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.264490 Sep 12 14:16:29.624932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 209/422] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:29 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:29.629312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:29.629903 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:29.636704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.637392 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.637918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.639230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:29.639744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:29.640450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:29.653660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:29.663563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-54921b67-34f7-45f1-bf5e-914a8fed59ed tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.277663 Sep 12 14:16:29.674865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 214/423] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:29 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:29.724877 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:29.733476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8a3e15c-05f0-4c56-bd61-ea5322cabbd2 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.107539 Sep 12 14:16:29.734059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 210/424] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:29 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:30.649814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:30.650484 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:30.657339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:30.658470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:30.658919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:30.659706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:30.660160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:30.660659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:30.687443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:30.689065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:30.694625 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:30.695234 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:30.695744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:30.696571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:30.697094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:30.697587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:30.759297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:30.928718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=12 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:31.118415 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:31.125459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:31.127994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:31.129527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:31.130816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9d1f61ae-7d9f-4108-8fb2-72306de022ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.485003 Sep 12 14:16:31.131865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 215/425] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:30 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:31.142813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:31.143492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:31.152354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:31.152840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:31.153267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:31.153960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:31.154432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:31.154891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:31.156926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c5bb410-b053-4a61-8e0c-5aae67da5dca tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.468010 Sep 12 14:16:31.166998 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 211/426] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:30 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:31.230134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:31.239405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a4b7f27c-03b6-4e8f-95fe-356f45e50194 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.106452 Sep 12 14:16:31.239988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 216/427] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:31 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:32.156170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:32.156747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:32.163336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.163820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.164349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.164995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.165453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.165874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.179590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:32.180213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:32.186407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.186912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.187342 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.188290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.188769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.189186 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.373479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:32.383332 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:32.384763 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:32.386259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6f5f7df-59bf-4591-b321-3c4d214e9c78 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.233762 Sep 12 14:16:32.400021 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:32.403128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 212/428] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:32 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:32.408740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-944528a1-1ae7-4a33-bb14-88882362c2c1 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.232764 Sep 12 14:16:32.409389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 217/429] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:32 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:32.412515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:32.413446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:32.419780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.420263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.420873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.421714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:32.422297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:32.422868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:32.489204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:32.497592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3852353-5794-4b70-932c-d1c5b1ad5edb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.093340 Sep 12 14:16:32.498504 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 213/430] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:32 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:33.414175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:33.414807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:33.421351 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.421829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.422258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.423026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.423483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.423907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.433394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:33.434965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:33.442126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.442964 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.443401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.444099 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.444912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.445285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.627175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:33.640011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:33.643003 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:33.644694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:33.646084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8d9757df-f65d-4ac6-85bc-3664cebbc979 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.235869 Sep 12 14:16:33.649842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63757f39-9752-4cc7-8388-4acfbdda8d49 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.222108 Sep 12 14:16:33.662012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 218/431] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:33 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:33.663551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 214/432] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:33 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:33.667298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:33.667912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:33.673911 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.674392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.674821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.675525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:33.675980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:33.676405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:33.739372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:33.747240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8c16b475-5f6e-4c3d-9302-20b7af10062e tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1471 microversion: 2.1 time: 0.083868 Sep 12 14:16:33.747797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 219/433] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:33 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:34.673649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:34.675105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:34.677101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:34.678694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:34.682020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:34.682584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:34.683205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:34.683962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:34.684548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:34.685122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:34.686268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:34.686754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:34.687217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:34.688239 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:34.689237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:34.689936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:34.989232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:34.993739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:34.998586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5271bc06-6ff0-46f9-accc-dd950b75ea1d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.325459 Sep 12 14:16:34.999375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 220/434] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:34 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:35.004620 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:35.005450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:35.014989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:35.016447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:35.017624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2b1f119-ae47-4de1-a0bd-833264a75dda tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1751 microversion: 2.20 time: 0.349877 Sep 12 14:16:35.018186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 215/435] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:34 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1751 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:35.019523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:35.020015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:35.020456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:35.021160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:35.021613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:35.022039 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:35.058441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:35.059751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:35.060423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:35.061083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lazy-loading 'fault' on Instance uuid 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:16:35.136636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:35.146638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3f1a6cc5-265a-40cb-9fd5-e52eb086de20 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 200 len: 1308 microversion: 2.1 time: 0.145722 Sep 12 14:16:35.147597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 221/436] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:34 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:35.219776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:35.229453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:35.229949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:35.230452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:35.242263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] Creating event network-changed:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:16:35.247246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-004b8d33-0e6d-407c-a5d1-5ad66d590a98 req-84d8d635-3f69-4c11-97fb-49a9ebe027e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Sep 12 14:16:35.248167 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 216/437] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:36.021943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:36.022559 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:36.029038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.029516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.029942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.030616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.031089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.031507 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.042762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:36.043513 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:36.049487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.049966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.050398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.051110 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.051565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.051989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.220506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:36.228325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7b4c9a7f-8876-4cd7-8b4d-4f1f4ef97a2b tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.210175 Sep 12 14:16:36.228895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 222/438] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:36 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:36.233303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:36.233902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: 673ee208-578b-46e3-b4e0-ebd0ad4f57d6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:36.234028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:36.239650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.240137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.240552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.241235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:36.241682 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:36.242100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:36.243656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:36.245097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:36.246309 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2328c383-6394-4b2d-a8fa-9843eb9261a9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.207758 Sep 12 14:16:36.246922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 217/439] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:36 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:36.255338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] HTTP exception thrown: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Request method failure captured: Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 HTTP/1.1 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz7y3sCzO2BNGK6BjDGQO-x6_3m0Ja3KcsFE2tGP1k9bZ61hdcMNq-_WmOLk_2NzypKpYRMw1CTFAFqx-yO2lxOEmTQsM82JuBT_N85tuoe3VnKGz1v1EIuGNXcAVDxh11VhJf7TPNoTY-1UvgpUaRH86i7hfRsdHaQtpelY6eX8QX4 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 34866fb3f98042d38c922bf3552c4e69 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:16:36.257026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34866fb3f98042d38c922bf3552c4e69", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 34866fb3f98042d38c922bf3552c4e69 Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesSnapshotTestJSON-948357311-project Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 02fd338d362a461a846a454c487bf669 Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesSnapshotTestJSON-948357311-project Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. Sep 12 14:16:36.258605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '673ee208-578b-46e3-b4e0-ebd0ad4f57d6'} Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:16:36.259429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. Sep 12 14:16:36.260792 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:36.261886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Returning 404 to user: Instance 673ee208-578b-46e3-b4e0-ebd0ad4f57d6 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:16:36.261886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-91ed4fc8-2d07-40ff-8790-811dc3957a48 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6" status: 404 len: 111 microversion: 2.1 time: 0.028584 Sep 12 14:16:36.261886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:36 2022] GET /compute/v2.1/servers/673ee208-578b-46e3-b4e0-ebd0ad4f57d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:16:37.250220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:37.250756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:37.252803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:37.258137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:37.258608 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:37.259067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:37.259743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:37.260216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:37.260631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:37.271647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:37.272250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:37.278578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:37.279134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:37.279520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:37.280196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:37.280638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:37.281052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:37.441532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:37.449729 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d392dea9-d823-4281-8e23-79bc026d4e18 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.203332 Sep 12 14:16:37.450389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 218/441] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:37 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:37.467162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:37.476276 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:37.477714 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:37.478889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-479da22a-9de5-4b21-b6b5-a0aae54655af tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.211089 Sep 12 14:16:37.479438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 224/442] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:37 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:38.471735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:38.472341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:38.478340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:38.478822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:38.479282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:38.479964 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:38.480414 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:38.480829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:38.504384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:38.504995 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:38.511611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:38.512185 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:38.512707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:38.513469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:38.514034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:38.514551 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:38.663968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:38.666288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:38.673036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-662ea1ea-cb80-4c2e-b914-1bd0adb2d1fe tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.205745 Sep 12 14:16:38.673694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 219/443] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:38 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:38.685850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:38.695238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:38.696670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:38.697817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20c9d438-3eca-4f1a-8bac-f3cbc2110c15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.197428 Sep 12 14:16:38.698404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 225/444] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:38 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:39.696005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:39.696666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:39.706050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:39.706547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:39.707708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:39.708429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:39.708887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:39.709651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:39.723783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:39.724392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:39.746294 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:39.746546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:39.746809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:39.747547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:39.748014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:39.748424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:39.975062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:39.987230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:39.992447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3a8438c-4538-4030-b735-ec4829f85888 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.300124 Sep 12 14:16:39.993174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 220/445] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:39 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:40.013206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:40.015153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:40.016628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cc08e6b9-80b4-4836-87b0-ff27e9de02d1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.297080 Sep 12 14:16:40.017959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 226/446] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:39 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:41.020532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:41.021179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:41.027344 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:41.028128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:41.028813 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:41.029591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:41.030115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:41.030731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:41.042369 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:41.042959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:41.049597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:41.050162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:41.050662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:41.051405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:41.051857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:41.052307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:41.068752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:41.238791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:41.247857 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e720ca3d-b40e-4a05-8a78-76a8b29f92ef tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.231777 Sep 12 14:16:41.248797 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 221/447] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:41 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:41.252822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:41.265766 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:41.268943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:41.270677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-df50c318-c334-407e-a215-b6bc53f91324 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.232726 Sep 12 14:16:41.271939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 227/448] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:41 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:42.272789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:42.273397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:42.279373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:42.279862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:42.280296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:42.280984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:42.281434 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:42.281854 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:42.296868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:42.297515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:42.304720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:42.305115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:42.305549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:42.306250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:42.306706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:42.307160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:42.495573 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:42.506347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a87dd46a-17a4-40fa-b714-4460cbb4b8ab tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.237307 Sep 12 14:16:42.518864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 222/449] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:42 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:42.537151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:42.546241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:42.547763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:42.549120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-79205f40-f151-47f5-bdca-32c93e3f7fe6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.256211 Sep 12 14:16:42.549852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 228/450] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:42 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:43.530873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:43.531538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:43.540766 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:43.541522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:43.542131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:43.543042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:43.543643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:43.544211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:43.574692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:43.575558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:43.583970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:43.584807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:43.585465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:43.586999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:43.587695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:43.588330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:43.751855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:43.759986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0113ac71-4d7a-4f9d-a082-f1db3c17b6b8 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.234049 Sep 12 14:16:43.760874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 223/451] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:43 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:43.785298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:43.793930 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:43.796027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:43.797176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6559ab6-144b-45d7-bd50-0a2aed21813d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.226290 Sep 12 14:16:43.797767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 229/452] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:43 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:44.103400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "name": "network-vif-plugged", "status": "completed", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:44.115653 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:44.116160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:44.116648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:44.136020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] Creating event network-vif-plugged:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:16:44.143258 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-25960971-6dbd-4c36-9903-d09feb7979d2 req-a4644621-dedb-4d31-a9b4-d5bf39eb102d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044201 Sep 12 14:16:44.144730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 224/453] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:44.787024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:44.788847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:44.792705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:44.796833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:44.797389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:44.797828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:44.798522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:44.799014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:44.799432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:44.824206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:44.825672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:44.832930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:44.833776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:44.834431 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:44.835400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:44.836066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:44.836715 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:44.996571 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:45.017478 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a24fbdd4-d8ee-457e-a9b3-17fdc39afc59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.236093 Sep 12 14:16:45.021349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:45.027431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 230/454] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:44 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:45.031019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:45.032830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:45.034017 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cdf02e5-5b7b-4828-85ce-b6fe2a5b9c1e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.214322 Sep 12 14:16:45.034572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 225/455] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:44 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:45.211914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-611754363", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "networks": [{"uuid": "a8d56a03-43b5-4483-b95f-c332a61e44c8"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:45.265972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] validate_networks() for [('a8d56a03-43b5-4483-b95f-c332a61e44c8', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:16:45.641005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:16:45.641461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:16:45.641934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:16:45.642487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:16:45.642933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:16:45.652103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:45.652977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:45.653421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:45.654151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:45.654602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:45.655048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:45.671923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Getting quotas for project 34866fb3f98042d38c922bf3552c4e69. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:16:45.676237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Getting quotas for user 02fd338d362a461a846a454c487bf669 and project 34866fb3f98042d38c922bf3552c4e69. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:16:45.689004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:16:45.691201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:16:45.737746 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-26a528f7-a29a-4265-aee6-f8328654e30b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530098 Sep 12 14:16:45.738392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 231/456] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:16:45.749810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43e5baa0-5537-4180-8f6b-b40c7cc3db88 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:45.750424 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43e5baa0-5537-4180-8f6b-b40c7cc3db88 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:45.880701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-43e5baa0-5537-4180-8f6b-b40c7cc3db88 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:45.893749 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43e5baa0-5537-4180-8f6b-b40c7cc3db88 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1218 microversion: 2.1 time: 0.147629 Sep 12 14:16:45.894984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:45 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:46.040857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:46.042059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:46.052178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.052818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.053355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.054364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.054957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.055482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.060676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:46.061925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:46.069656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.070737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.071518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.072595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.073369 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.074011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.280552 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:46.291160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-38498600-c1ee-4dcf-932d-2baf996f3528 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.254790 Sep 12 14:16:46.292175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 232/458] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:46 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:46.299336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2c83b48-e80b-4594-b916-07634dcab7a6"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:46.301879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:46.315887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.316327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.316763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.317467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.317921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.318350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.342428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:46.357221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:46.358752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:46.360667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a23060ae-fee3-4749-ae7a-01017c5a95fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.305038 Sep 12 14:16:46.361087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 227/459] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:46 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:46.948332 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:46.949015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:46.955665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.956147 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.956581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:46.957472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:46.957926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:46.958366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:47.023330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:47.031470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a886966-2a07-4514-9b90-29079f9617ba tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1222 microversion: 2.1 time: 0.086956 Sep 12 14:16:47.032972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 228/460] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:46 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:47.317665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:47.318199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:47.324450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:47.324938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:47.325373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:47.326079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:47.326524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:47.326973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:47.462284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:47.470524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1aff3800-60da-484c-9cc6-ce82835c64c0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.157478 Sep 12 14:16:47.483392 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 229/461] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:47 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:47.491730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:47.492349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:47.498275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:47.498757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:47.499221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:47.499909 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:47.500364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:47.501321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:47.636136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:47.646644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:47.648127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:47.649291 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a042c60f-f456-4a3e-8ff5-d8e7e4c42b2a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.164502 Sep 12 14:16:47.649850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 230/462] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:47 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:48.054711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:48.055351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:48.062028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.063085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.063683 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.064553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.065195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.065827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.136688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:48.146015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d66e6c22-f339-41ee-bd88-64339ed46b25 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1222 microversion: 2.1 time: 0.095074 Sep 12 14:16:48.146978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 231/463] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:48 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:48.496430 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:48.497040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:48.503164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.503648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.504084 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.504779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.505232 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.505655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.643812 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:48.654283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-163d8bad-93b9-453a-a0ec-35784ccb3fdb tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.161577 Sep 12 14:16:48.654768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 232/464] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:48 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:48.673241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:48.673815 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:48.679997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.680491 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.680930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.681630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:48.682087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:48.682510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:48.818111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:48.828269 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:48.830547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:48.831763 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53828d96-0703-44d9-aef5-afc15e6fb8d3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.162313 Sep 12 14:16:48.832312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 233/465] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:48 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:49.169018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:49.169790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:49.175981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.176452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.176878 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.177549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.177992 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.178405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.240419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:49.248006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3c43c4a-8ecc-4b33-b725-ab69a087c092 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1222 microversion: 2.1 time: 0.082781 Sep 12 14:16:49.248564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 234/466] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:49 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:49.498376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9c23d230-bcb2-4739-adab-fa782a8f5252 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.203792 Sep 12 14:16:49.499000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 233/467] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:16:46 2022] POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments => generated 194 bytes in 3206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:49.677993 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:49.678600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:49.684951 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.685365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.685798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.686483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.686966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.687385 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.811521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:49.819264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b8d3d65-fd49-4803-9337-51cfa9972a70 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.144994 Sep 12 14:16:49.819832 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 235/468] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:49 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:49.856304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:49.856991 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:49.864095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.864567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.864995 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.865670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:49.866113 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:49.866531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:49.996422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:50.004997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:50.006450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:50.007628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c222af60-3f3e-4f7b-9b40-0c0afea44f23 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.155536 Sep 12 14:16:50.008176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 234/469] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:49 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:50.272548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:50.273165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:50.279015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:50.279496 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:50.279927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:50.280608 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:50.281062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:50.281484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:50.345216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:50.352911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10af7a08-ea6f-4c5f-af75-9d9d36ed3ebb tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1270 microversion: 2.1 time: 0.084223 Sep 12 14:16:50.353482 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 236/470] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:50 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:50.841384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:50.841986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:50.848345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:50.848800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:50.849224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:50.849898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:50.850342 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:50.850758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:50.980396 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:50.990140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f87c42ac-5e14-4b8e-8456-48dcca113d64 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1359 microversion: 2.1 time: 0.152518 Sep 12 14:16:50.990703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 235/471] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:50 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:51.033364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:51.033965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:51.040268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:51.040852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:51.041284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:51.041961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:51.042405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:51.042818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:51.167476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:51.176515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:51.177948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:51.179119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56b812e0-0223-4453-80b1-e4f1ad6eb8fe tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.150051 Sep 12 14:16:51.179668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 237/472] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:51 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:51.375801 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:51.376327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:51.382863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:51.383354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:51.383779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:51.384455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:51.384900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:51.385311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:51.456652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:51.464303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-621ed7be-7915-40a0-8758-8eb30643a394 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1270 microversion: 2.1 time: 0.092465 Sep 12 14:16:51.464856 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 236/473] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:51 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:52.013537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.014631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:52.021983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.022468 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.022922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.023617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.024069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.024490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.028510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:52.154685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.164590 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-832f828c-e674-4acd-b62b-1caefa34ba73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1549 microversion: 2.1 time: 0.155171 Sep 12 14:16:52.165176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 238/474] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:52.187245 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.188717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:52.194917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.195400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.195829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.196556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.197009 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.197429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.204046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.204685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:52.210590 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.211170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.211682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.212431 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.212941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.213535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.405550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.407617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.416127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-285731ba-6c37-421d-a44e-affb81c76ff4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1549 microversion: 2.1 time: 0.232651 Sep 12 14:16:52.416720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 237/475] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:52.420043 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.421500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.423217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-681acfa0-9cc9-4ce0-b0c4-147e7071a792 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.223007 Sep 12 14:16:52.423769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 239/476] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:52.439269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.444380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.445140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Searching by: {'deleted': False, 'project_id': '40918a5eb3134a00999618cb65dedbbd'} {{(pid=120624) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 12 14:16:52.451667 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.452145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.452582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.453274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.453759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.454224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.488139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.488907 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:52.495010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.495612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.496170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.496963 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.497525 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.498053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.551722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.multi_cell_list [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120624) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 12 14:16:52.633045 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.641984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f04efb24-3f2b-4ba0-b993-6cd8bbf34d6d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.157722 Sep 12 14:16:52.644478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 240/477] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:52.661540 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b6b411f6-4a61-408e-b11c-f508c6b8b4c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226818 Sep 12 14:16:52.662136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 238/478] 10.222.0.42 () {58 vars in 1125 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:52.676644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:52.677303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:52.683775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.684336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.684875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.685677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:52.686214 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:52.686692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:52.820957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:52.829102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c42be3e-2c7d-4691-9607-0aea1e769320 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1549 microversion: 2.1 time: 0.159106 Sep 12 14:16:52.830107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 241/479] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:52 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:53.199034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c251a-73a8-4862-b62f-23dee73e3239", "tag": "707f49d3-a873-4bc2-9e47-7281fb27da2b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:53.211150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:53.211713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:53.212139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:53.224082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] Creating event network-changed:707f49d3-a873-4bc2-9e47-7281fb27da2b for instance b62c251a-73a8-4862-b62f-23dee73e3239 on hv-cinder-82002 Sep 12 14:16:53.228789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-c13bb534-a08b-492b-b32e-a2ef1b3eecd8 req-59d491df-4485-44e7-a38c-66def9f78c18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Sep 12 14:16:53.229387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 239/480] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:53.450382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:53.451117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:53.458351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:53.459005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:53.459536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:53.460300 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:53.460791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:53.461420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:53.589058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:53.597948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:53.599424 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:53.600744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d367f796-94b9-4d66-afb6-68ddcfb67f29 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.154845 Sep 12 14:16:53.601312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 242/481] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:53 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:53.666587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:53.667305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:53.673808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:53.674281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:53.674733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:53.675437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:53.675876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:53.676287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:53.806744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:53.815138 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f85cb0e3-5281-45d0-a76c-d98b4f129b1d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.153189 Sep 12 14:16:53.815696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 240/482] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:53 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:54.398545 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aa43f01-80d5-4525-aa26-636b5975602e"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:54.400984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:54.407817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.408301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.408736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.409428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.409880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.410299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.626401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:54.627275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:54.633170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.633641 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.634066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.634746 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.635225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.635645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.765777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:54.774297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:54.775743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:54.776881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-350802d4-a3f0-40cc-849e-b75cf2effa88 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.155088 Sep 12 14:16:54.777431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 241/483] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:54 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:16:54.844853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:54.845501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:54.855061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.855970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.856539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.857433 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:54.857931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:54.858401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:54.998029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:55.007430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-437eaed1-10bf-45b5-9ba3-61efd29439e1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.166320 Sep 12 14:16:55.023028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 242/484] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:54 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:55.023028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:55.023448 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab0730a1-d0c2-4860-a8f6-b54d1cf7de91 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619633 Sep 12 14:16:55.023879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.023982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 243/485] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:16:54 2022] POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:55.024212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.024212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.030812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.031975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.032496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.033038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.151812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:55.161335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'services' on Instance uuid 58855138-24d4-43f5-bbf2-c470cb31e738 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:16:55.280523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b9088f36-3a94-47f9-9f1f-2192b2f0d7ea tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments/6a3b21e7-439d-421d-9215-b8d600f10406" status: 202 len: 0 microversion: 2.1 time: 0.270998 Sep 12 14:16:55.281947 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 243/486] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:16:55 2022] DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments/6a3b21e7-439d-421d-9215-b8d600f10406 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:16:55.372260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:55.372843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.379875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.380356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.380818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.381504 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.381952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.382372 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.405213 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8533b6e3-9e56-474a-af30-6e433e1d079b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/ips" status: 200 len: 150 microversion: 2.1 time: 0.037743 Sep 12 14:16:55.405769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 244/487] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:16:55 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:16:55.418428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f52634e8-cf35-4987-8c5a-d0d4509e7aa7"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:55.420919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.427764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.428233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.428659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.429325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.429768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.430182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.506664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/os-volume_attachments HTTP/1.1 Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 74 Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:16:55.508389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {"volumeAttachment": {"volumeId": "f52634e8-cf35-4987-8c5a-d0d4509e7aa7"}} Sep 12 14:16:55.509987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'server_id': 'c4d0572f-025c-430b-87d7-83f02ec83568', 'body': {'volumeAttachment': {'volumeId': 'f52634e8-cf35-4987-8c5a-d0d4509e7aa7'}}} Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:55.510852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:16:55.512062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 400 to user: Invalid volume: volume f52634e8-cf35-4987-8c5a-d0d4509e7aa7 is already attached to instances: bb08f5b9-cb33-43b9-a82c-116ad362579f {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-17e9327c-c8bd-4b00-92a0-cbe9d12edfe7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095699 Sep 12 14:16:55.513223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 244/488] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:16:55 2022] POST /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 12 14:16:55.518968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:55.519465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.525798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.526278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.526731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.527444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.527898 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.528321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.553307 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:16:55.626333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09cd56c1-fa94-4010-b99c-838557a18170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 204 len: 0 microversion: 2.1 time: 0.111041 Sep 12 14:16:55.626923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 245/489] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:16:55 2022] DELETE /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:16:55.634918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:55.635533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.642353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.642824 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.643274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.643950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.644396 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.644808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.683545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:55.775162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:55.783307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c6d27ade-2c12-46e1-b483-6c70098e4f5d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1682 microversion: 2.1 time: 0.152231 Sep 12 14:16:55.783856 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 245/490] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:55 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:55.801964 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:55.802663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:55.808974 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.809454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.809884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.810589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:55.811067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:55.811487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:55.897101 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:55.943241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:55.952001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:55.954041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:55.955245 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bbf0292b-1ed7-4778-a209-1851296e62a1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.157458 Sep 12 14:16:55.955807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 246/491] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:55 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:56.038908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:56.039469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:56.045327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.045809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.046240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:56.046948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.047402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.047820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:56.177481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:56.185160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3d393196-b1eb-4a05-b53b-2b4a5b275f4c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.150139 Sep 12 14:16:56.185736 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 246/492] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:56 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:56.806961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:56.807737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:56.815381 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.815912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.816461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:56.817450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.818139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.818905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:56.948403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:56.956813 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72205dfb-9c42-4b94-9a3c-7ee7df3df02b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1682 microversion: 2.1 time: 0.154090 Sep 12 14:16:56.957536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 247/493] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:56 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:56.978955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:56.979644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:56.986030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.986509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.986966 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:56.987649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:56.988101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:56.988546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:57.121708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:57.130778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:57.132238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:57.133376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f6ea5063-efab-470d-bed2-2ddd71eccd0b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.158392 Sep 12 14:16:57.133948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 247/494] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:56 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:57.208452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:57.209050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:57.214794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:57.215303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:57.215727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:57.216409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:57.216856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:57.217268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:57.340665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:57.348284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c6e384c-a61c-41c2-a379-d71147e46de0 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.143589 Sep 12 14:16:57.348841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 248/495] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:57 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:57.980353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:57.980964 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:57.987305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:57.987778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:57.988204 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:57.988879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:57.989322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:57.989736 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:58.122049 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:58.129876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1f365a82-862d-4b19-a2bb-8ecf930e06c7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1682 microversion: 2.1 time: 0.153315 Sep 12 14:16:58.130435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 248/496] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:57 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:58.158722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:58.159391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:58.167340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:58.167891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:58.168571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:58.169931 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:58.170775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:58.171432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:58.370961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:58.372026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:58.379513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:58.380107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:58.380759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:58.381666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:58.382309 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:58.382974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:58.670345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:58.673800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:58.679823 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:58.681252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:58.681365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fe28450a-2db3-4366-be25-53b0447f280f tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.314345 Sep 12 14:16:58.681847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 249/497] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:58 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:16:58.682398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2664766-820f-4f53-8fa0-762aba60e309 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.528774 Sep 12 14:16:58.682962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 249/498] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:58 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:16:59.153515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:59.154768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:59.165923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:16:59.168228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:59.173268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.173760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.174190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.175492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.175492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.180062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.180543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.180971 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.181669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.182121 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.182538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.186233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.220730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'flavor' on Instance uuid eb689d73-c89d-4341-9742-b8b4005976dc {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:16:59.340249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:59.349086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-73ae1473-e525-4c7a-85f3-185c09b762c9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1682 microversion: 2.1 time: 0.199349 Sep 12 14:16:59.357074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:16:59.364013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 250/499] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:59 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:59.394739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4b05e79-fb72-4f08-bda2-2d09ea7731cd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/action" status: 200 len: 32 microversion: 2.1 time: 0.224374 Sep 12 14:16:59.394739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 250/500] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:16:59 2022] POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:16:59.397311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:59.397926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:59.404943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.405441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.405841 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.407213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.407662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.408094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.631750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:59.643392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d59e5d61-7b32-45c1-9e64-e2642a844953 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.250021 Sep 12 14:16:59.643969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 251/501] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:59 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:59.708192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:59.709111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:16:59.709295 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:59.709719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:16:59.715793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.716169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.716292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.716695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.716954 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.717394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.717569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.717846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.718458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:16:59.718599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.719115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:16:59.719542 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:16:59.976382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:59.979860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:16:59.992125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-850739d3-6d8e-4e4a-b041-02c354c8f2b6 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.289900 Sep 12 14:16:59.992125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 251/502] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:16:59 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:16:59.999567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:00.001692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:00.003193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6d8cc0ad-dc06-4d6a-9ccf-72098ce36db1 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.297548 Sep 12 14:17:00.003943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 252/503] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:16:59 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:00.085159 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d0572f-025c-430b-87d7-83f02ec83568", "name": "network-vif-deleted", "tag": "11973ac5-af69-497e-8b4e-7b63054c309b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:00.095521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.096203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.096641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.111604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] Creating event network-vif-deleted:11973ac5-af69-497e-8b4e-7b63054c309b for instance c4d0572f-025c-430b-87d7-83f02ec83568 on hv-cinder-82002 Sep 12 14:17:00.117538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-edcb2175-326a-4784-a2af-2c6e52b82631 req-596dcdbb-dfeb-492c-aaa8-5d35e152cf46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Sep 12 14:17:00.119057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 252/504] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:00.376014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:00.376642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:00.383387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.383572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.384005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.384699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.385154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.385573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.441671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.442158 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.442833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.443249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'fault' on Instance uuid c4d0572f-025c-430b-87d7-83f02ec83568 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:00.494381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:00.502901 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a39d3c6-ac02-4fdd-8ed9-34d5a2b9e357 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 200 len: 1331 microversion: 2.1 time: 0.131236 Sep 12 14:17:00.503511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 253/505] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:00 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:00.667773 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:00.669094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:00.676553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.677136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.677645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.678410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.679437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.679942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.816639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:00.826907 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff60eddc-b5c1-4c3e-8a4c-8870cda2d8d4 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.163207 Sep 12 14:17:00.827801 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 253/506] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:00 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:00.922759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "name": "network-vif-plugged", "status": "completed", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:00.937225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:00.939572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:00.940505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:00.956842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] Creating event network-vif-plugged:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:17:00.968367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-202ad1c1-680a-4858-988b-e9a288b033b5 req-b29dd570-9206-4777-b87e-165d193fd9ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047387 Sep 12 14:17:00.969889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 254/507] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:01.016566 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:01.017175 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:01.025814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.026319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.034630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:01.035467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:01.038914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.039866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.043171 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.043639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.049013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.049515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.049950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.053130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.053603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.054025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.290267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:01.310274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:01.313612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:01.315190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20b92c38-8eb6-45e4-92c7-a19e4dafd7d4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.286928 Sep 12 14:17:01.330870 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:01.332105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 255/508] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:01 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:17:01.340675 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1263469-ae0d-4143-8bcc-d35665200a00 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.328470 Sep 12 14:17:01.341260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 254/509] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:01 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:01.525356 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:01.526611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:01.536844 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.539058 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.539859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.543734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.548224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.548850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.583765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 HTTP/1.1 Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:17:01.585712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:17:01.587141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'c4d0572f-025c-430b-87d7-83f02ec83568'} Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:17:01.587851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:17:01.589061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:01.591390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:17:01.591390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-63a55771-eb88-41a6-b406-970d66c50e0b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 404 len: 111 microversion: 2.1 time: 0.065628 Sep 12 14:17:01.591390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 256/510] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:01 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:17:01.596443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-122c3c41-d362-4f40-b5f7-48b585165502 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '.version_select at 0x7f7560a17550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:01.620801 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-122c3c41-d362-4f40-b5f7-48b585165502 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126430200" status: 202 len: 0 microversion: 2.1 time: 0.027940 Sep 12 14:17:01.624794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 255/511] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 12 14:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126430200 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:01.850419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:01.851195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:01.859183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.860273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.860780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:01.861537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:01.862045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:01.862614 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.081598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:02.090335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-04840cc9-cb56-496b-a3d6-bdb024877882 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.243691 Sep 12 14:17:02.091275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:01 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:02.343266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:02.343941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:02.350462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.351042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.351476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.352163 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.352608 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.353027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.364395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:02.365384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:02.371741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.372495 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.373149 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.374075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.374634 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.375761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.487910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:02.553407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:02.560469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:02.561959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:02.564297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:02.565453 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-136848e8-d865-4809-9a70-9d476a71f780 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.226671 Sep 12 14:17:02.566010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 256/513] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:02 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:02.568952 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b8542953-08b7-4edd-98f6-f85a5dbca00c tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.208299 Sep 12 14:17:02.572707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 258/514] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:02 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:02.572839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:02.572839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:02.577001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.577481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.577911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.578595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.579062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.579478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.658269 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'services' on Instance uuid bb08f5b9-cb33-43b9-a82c-116ad362579f {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:02.729256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bd2b124-da0f-474d-ad8f-ffacafb678eb tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments/f52634e8-cf35-4987-8c5a-d0d4509e7aa7" status: 202 len: 0 microversion: 2.1 time: 0.161965 Sep 12 14:17:02.729860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 257/515] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:17:02 2022] DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments/f52634e8-cf35-4987-8c5a-d0d4509e7aa7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:02.741402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:02.744327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:02.755926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.758260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.758828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.759698 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:02.760283 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:02.760794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:02.807712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a93a7f64-88b4-4ecf-9a7e-49f4971cca91 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072955 Sep 12 14:17:02.808786 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 259/516] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:02 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:02.988697 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62c251a-73a8-4862-b62f-23dee73e3239", "name": "network-vif-plugged", "status": "completed", "tag": "707f49d3-a873-4bc2-9e47-7281fb27da2b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:03.002446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.002959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.003395 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.014644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] Creating event network-vif-plugged:707f49d3-a873-4bc2-9e47-7281fb27da2b for instance b62c251a-73a8-4862-b62f-23dee73e3239 on hv-cinder-82002 Sep 12 14:17:03.019261 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2cd1625e-a07a-4502-b309-d598943ce3c4 req-d6d715ff-5099-47eb-9428-69beb6f5b655 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035062 Sep 12 14:17:03.019838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 258/517] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:03.113429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:03.114025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:03.120145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.120611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.121036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.121709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.122152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.122566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.250312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:03.252489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:03.259580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4f0de4c0-5bcf-4db6-824c-fd6eef23f52b tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.149955 Sep 12 14:17:03.260146 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 260/518] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:03 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:03.591025 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:03.591725 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:03.595453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:03.598166 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.598534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.599200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.599487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:03.600075 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.600518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.600936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.610681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.611293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.611794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.612704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.613347 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.613952 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.882077 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:03.891144 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:03.892579 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:03.893742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-726f545e-29bc-4716-987b-b076cdae8a51 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1807 microversion: 2.20 time: 0.307497 Sep 12 14:17:03.899368 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 259/519] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:03 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:03.901979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:03.911026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fb877bb9-77bd-4fd7-ac9f-ed36ce37323a tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.322497 Sep 12 14:17:03.915013 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:03.915719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 261/520] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:03 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:03.918195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:03.926552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.927077 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.928361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.929874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:03.930340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:03.930760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:03.964777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7484317-b200-48cf-aebc-97efa21b4739 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064051 Sep 12 14:17:03.965341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 260/521] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:03 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:04.283690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:04.284297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:04.290287 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.290742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.291227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:04.291909 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.292404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.292835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:04.424241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:04.432334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5beee11e-ee65-4124-a6bb-4201db51f6b0 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.153076 Sep 12 14:17:04.432893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 262/522] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:04 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:04.919535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:04.920135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:04.926383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.926875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.927304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:04.929364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.929364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.929364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:04.934305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:04.934949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:04.941781 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.942257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.942682 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:04.943394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:04.943842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:04.944259 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:05.125500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:05.129523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:05.134148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:05.135612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:05.136765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbe68e4a-6c1b-485a-8126-c291f7bc7be2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1794 microversion: 2.20 time: 0.221093 Sep 12 14:17:05.137395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dd1c842c-c73b-47d7-9a08-805f7561fc4b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1318 microversion: 2.1 time: 0.206796 Sep 12 14:17:05.137687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 261/523] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:04 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:05.138168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 263/524] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:04 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:05.142994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:05.145108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:05.150707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:05.151225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:05.151651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:05.152327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:05.152781 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:05.153198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:05.183370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e4c05fb-8168-486b-a8ca-6184f1be78a6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Sep 12 14:17:05.183925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 262/525] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:05 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:05.456176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:05.456938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:05.464834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:05.465310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:05.465748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:05.467269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:05.468125 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:05.468802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:05.606048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:05.614975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c7eadf66-617d-4e2c-917b-1b2686c531d6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.163623 Sep 12 14:17:05.615549 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 264/526] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:05 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:06.161307 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:06.161826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:06.164408 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:06.169584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.170063 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.170494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.171209 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.171668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.172089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.196177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:06.198324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:06.205280 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.205764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.206195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.206904 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.207358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.207776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.238649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-625752ef-291c-44d2-8770-1b8a44c3416f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Sep 12 14:17:06.239255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 265/527] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:06 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:17:06.299625 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:06.307125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4e11c0c-3b52-48e0-a260-c09b2759d307 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1507 microversion: 2.1 time: 0.149763 Sep 12 14:17:06.307692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 263/528] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:06 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:06.329691 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "914d279e-10ae-4881-9bc5-3599ba024241", "device": "/dev/sdb"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:06.332034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:06.337847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.338319 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.338748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.339445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.339892 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.340306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.637551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:06.638187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:06.644770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.645250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.645690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.646371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:06.646822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:06.647444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:06.776061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:06.784547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3cff0c9e-3784-4eea-9591-0e0293f07652 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.150938 Sep 12 14:17:06.785112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 264/529] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:06 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:06.974867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2c01324d-01c0-4dcc-9c29-06ab615ff22d tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "POST /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649402 Sep 12 14:17:06.975524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 266/530] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:17:06 2022] POST /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:07.021376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:07.022094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:07.028443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.029027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.029560 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:07.030309 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.030825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.032077 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:07.166105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:07.175287 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71aa22e7-c044-4d60-97b8-6e5c91cc638e tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1595 microversion: 2.1 time: 0.157633 Sep 12 14:17:07.175845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:07 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:07.252470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:07.254816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:07.261633 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.262516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.262659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:07.263344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.263793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.264247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:07.296641 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6504a9b2-2063-4910-988c-fa4c03fd8329 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049329 Sep 12 14:17:07.297912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 267/532] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:07 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:07.807794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:07.808428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:07.814896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.815387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.815819 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:07.816510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:07.816965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:07.817388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.058668 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:08.071336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-474fe1ca-8bbc-4c82-bf56-291f9493a401 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.267300 Sep 12 14:17:08.072752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:07 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:08.151660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:08.159757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.160307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.160743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.222914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Going to try to stop instance {{(pid=120624) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 14:17:08.269491 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8841df8-5008-49f5-93ce-387aa683536e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action" status: 202 len: 0 microversion: 2.1 time: 0.121878 Sep 12 14:17:08.273217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 268/534] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:17:08 2022] POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:17:08.279012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:08.279634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:08.287589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.288423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.288938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.289832 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.290490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.291211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.311869 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:08.317873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:08.325814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.326469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.327000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.327822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.329012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.329435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.360373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3d28b60f-6f92-4100-a990-8fd32c64b492 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054085 Sep 12 14:17:08.360939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 269/535] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:17:08 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:17:08.426735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:08.427172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:08.433557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.434031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.434454 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.435172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.435778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.436505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.462813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:17:08.536917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:08.549219 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9700dd90-a9c2-4afa-ad16-79b6380fbfdd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 204 len: 0 microversion: 2.1 time: 0.126184 Sep 12 14:17:08.550117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 270/536] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:17:08 2022] DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:17:08.551254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:08.558604 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:08.559446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:08.566191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.566755 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.567699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71a71787-1cb5-40e5-9732-06b5921fdaf5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.293030 Sep 12 14:17:08.567964 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:08.568297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 267/537] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:08 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:08.568853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:08.569410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:08.569936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.039216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:09.047577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7eca5912-51b2-4540-a319-2c2dfeab2503 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1680 microversion: 2.1 time: 0.493262 Sep 12 14:17:09.048150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 271/538] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:08 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1680 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:09.096030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:09.096934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:09.102863 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:09.103361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:09.103795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.104495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:09.104941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:09.105364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.121707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:09.303394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:09.312400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7dd703e7-d01a-409a-9d42-0363eb379e79 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.220772 Sep 12 14:17:09.318996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 268/539] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:09 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:09.340710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:09.350872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:09.351644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:09.352070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.367230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] Creating event network-changed:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:17:09.373505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-755ef5fb-bea9-4635-953b-4c9c42310a3c req-319a5afa-6e0b-410d-9567-9d15bea894d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036403 Sep 12 14:17:09.374113 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 272/540] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:09.591074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:09.591681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:09.599242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:09.600282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:09.601326 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.603299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:09.604444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:09.605184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:09.788313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:09.797413 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3836d99b-ff16-4777-901b-aea9c8ae279a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.210198 Sep 12 14:17:09.798002 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 269/541] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:09 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:10.073633 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:10.074329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:10.082247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.084054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.085358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.086438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.087134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.087771 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.280110 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:10.288458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9a6e1b84-9037-4644-b5d8-034e3087fa4e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1680 microversion: 2.1 time: 0.219799 Sep 12 14:17:10.289671 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 273/542] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:10 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:10.337845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:10.338564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:10.351026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.351782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.352384 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.353251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.353863 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.354435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.431664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1278969989"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:10.432843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:10.441171 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.441660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.442088 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.442987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.443603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.444187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.464462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:10.636277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:10.645688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72dec3d0-8a77-473d-ad4f-22e4b33f3718 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.311719 Sep 12 14:17:10.659190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 270/543] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:10 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:10.740275 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.network.security_group_api [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Adding security group 2a824313-c1b2-4e4f-ad64-9746fb4e0360 to port c158483b-3937-4578-983a-bbaad6989bb8 Sep 12 14:17:10.825256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:10.825938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:10.831824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.832511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.833147 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:10.834287 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:10.834937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:10.835515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.149287 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:11.160716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b94011d-3f2a-4ed6-85a6-f2b25927775e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.341200 Sep 12 14:17:11.161559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 271/544] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:10 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:11.292891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c1376fd4-9ebf-479b-bc64-1eb947d3ebf0 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action" status: 202 len: 0 microversion: 2.1 time: 0.865037 Sep 12 14:17:11.293506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 274/545] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:17:10 2022] POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:17:11.303839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:11.304464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:11.319104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:11.319104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:11.320458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.323768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.324264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.325144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.325646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.326205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.328401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.329059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.332288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.332288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.335314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.337056 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.416889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:11.426706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-748a3bed-5859-4939-ab2c-a66034cc315e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 200 len: 1613 microversion: 2.1 time: 0.117672 Sep 12 14:17:11.427962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:11 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:11.433433 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb08f5b9-cb33-43b9-a82c-116ad362579f", "name": "network-vif-deleted", "tag": "581da079-111d-4f64-ab1a-c5d8a6a8b6a2"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:11.445742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.446341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.446823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.464300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] Creating event network-vif-deleted:581da079-111d-4f64-ab1a-c5d8a6a8b6a2 for instance bb08f5b9-cb33-43b9-a82c-116ad362579f on hv-cinder-82002 Sep 12 14:17:11.480715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-f3cf373e-3df9-4457-9079-6f87650632b7 req-1e6b4b0c-51cc-4ab1-9ec0-49bf746c60fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051188 Sep 12 14:17:11.487596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 276/547] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:11.494114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:11.518193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.518640 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.519304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.534970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] Creating event network-changed:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:17:11.553255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-cfa67ff4-9a4c-45cc-ad77-971f1c400166 req-a8250a69-94e4-4c96-bc2e-5b5b24b11c17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063891 Sep 12 14:17:11.555874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 277/548] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:11.572162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:11.582997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33237b9d-e80b-49a8-8498-7f782bf1dd24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1761 microversion: 2.1 time: 0.284398 Sep 12 14:17:11.593450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 272/549] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:11 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1761 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:11.670036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:11.672249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:11.679914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.680802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.681502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.682597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:11.683306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:11.683818 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:11.847704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:11.861949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-41c71462-b3c2-4128-83a3-0502d52f929d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.196069 Sep 12 14:17:11.862956 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 278/550] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:11 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:12.184664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:12.185417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:12.191789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.192481 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.192924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:12.193642 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.194096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.200826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:12.379735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:12.387985 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccc7130d-4f71-495f-8d24-f8e84dda8542 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.207713 Sep 12 14:17:12.390755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 273/551] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:12 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:12.451644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:12.452258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:12.459360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.459838 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.460521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:12.461429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.461885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.462306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:12.476943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f HTTP/1.1 Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:17:12.478590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:17:12.480004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'bb08f5b9-cb33-43b9-a82c-116ad362579f'} Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:17:12.480776 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:17:12.482249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:17:12.483701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:17:12.483701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-33cc3c2a-47d4-4d26-9cfb-a5c59530b20c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 404 len: 111 microversion: 2.1 time: 0.032351 Sep 12 14:17:12.483701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 279/552] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:12 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:17:12.489263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1015b438-f5b0-4f2e-b773-0bbe4cb60952 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '.version_select at 0x7f75609b68b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:12.508494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1015b438-f5b0-4f2e-b773-0bbe4cb60952 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660550540" status: 202 len: 0 microversion: 2.1 time: 0.022927 Sep 12 14:17:12.509002 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 274/553] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 12 14:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660550540 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:12.885884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:12.886811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:12.894426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.894940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.895377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:12.896240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:12.896870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:12.897298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:13.099905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:13.108693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fc111d07-17c2-46dd-94cb-c2b6b84d6698 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.227001 Sep 12 14:17:13.109267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 280/554] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:12 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:13.188991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-222c3473-9ea5-46f2-ad33-949c1bbcf698 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: .version_select at 0x7f7560ab3820>, body: {"keypair": {"name": "tempest-keypair-86572089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5rYB/86mwcec3k1bkDB01/f2o4WnmkUBDG5BplNCWtz2BBXqwR5sTqs09Zdx0xePv1YYuUKjt5egdrhKwsdaV2813Ar17BR237AdNCMRFLcaqGoCApjW0HmmKTO254zg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:13.205164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-222c3473-9ea5-46f2-ad33-949c1bbcf698 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:17:13.208981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-222c3473-9ea5-46f2-ad33-949c1bbcf698 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:17:13.230074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-222c3473-9ea5-46f2-ad33-949c1bbcf698 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045902 Sep 12 14:17:13.230651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 275/555] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:17:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:13.415237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:13.415857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:13.424705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:13.425205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:13.425636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:13.426344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:13.426990 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:13.427447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:13.568349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:13.576196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cfc7076a-b961-401d-bd4d-3d4261022af6 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.164809 Sep 12 14:17:13.576773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 281/556] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:13 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:14.133486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:14.134101 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:14.141069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:14.141556 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:14.141989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:14.142702 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:14.143174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:14.143604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:14.275957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:14.285001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44f5e90e-5d2e-4073-b7e0-dc51f969fedd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.155525 Sep 12 14:17:14.285774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 276/557] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:14 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:14.482665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-389026966", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9236f9c0-b543-4fbe-9872-2a3e0012862d"}], "security_groups": [{"name": "tempest-securitygroup--2055167834"}], "key_name": "tempest-keypair-86572089", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:14.587530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] validate_networks() for [('9236f9c0-b543-4fbe-9872-2a3e0012862d', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:17:14.600406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:14.601217 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:14.607143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:14.607633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:14.608069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:14.608764 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:14.609216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:14.609638 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:14.795298 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:14.805030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28aa1b09-e865-41ad-853e-5f1d4161d5c2 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.208445 Sep 12 14:17:14.805603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 277/558] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:14 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:15.013508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:17:15.013927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:17:15.014395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:17:15.014827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:17:15.015256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:17:15.023877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.024351 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.024779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.025493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.025950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.026368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.042409 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:17:15.046887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:17:15.057597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:17:15.059881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:17:15.105877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-899e6b62-8904-4eec-bcc2-42f84e9e9d72 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627359 Sep 12 14:17:15.106523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 282/559] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:17:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:17:15.118207 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04a0256b-f4b2-41c6-8c05-9808c2d6ff68 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:15.118848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04a0256b-f4b2-41c6-8c05-9808c2d6ff68 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:15.176315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-04a0256b-f4b2-41c6-8c05-9808c2d6ff68 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:15.183275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04a0256b-f4b2-41c6-8c05-9808c2d6ff68 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1239 microversion: 2.1 time: 0.068963 Sep 12 14:17:15.183844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 278/560] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:15 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:15.309862 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:15.310478 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:15.317527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.318015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.318451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.319210 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.319764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.321154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.460429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:15.472950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3c2c2321-8929-4697-a335-15b57d53538d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.167260 Sep 12 14:17:15.481830 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 283/561] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:15 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:15.830250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:15.830777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:15.836835 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.837343 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.837775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.838458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:15.838937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:15.839357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:15.963835 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:15.973623 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-085a4564-2652-4f96-a869-47652936fd9d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.147915 Sep 12 14:17:15.977982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 279/562] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:15 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:16.205465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:16.206053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:16.212412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:16.212882 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:16.213310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:16.213979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:16.214422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:16.214858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:16.277496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:16.285523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-61d419a9-bf9f-49c8-bd28-7b31d1b698d8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1291 microversion: 2.1 time: 0.083941 Sep 12 14:17:16.286094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 284/563] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:16 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:16.496636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:16.497249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:16.504229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:16.504709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:16.505134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:16.505808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:16.506256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:16.506669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:16.883077 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:16.891273 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8563a122-50c8-4fa5-9b9d-b14833885879 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.398544 Sep 12 14:17:16.891837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 280/564] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:16 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:16.996817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:16.997344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:17.003427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.003898 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.004320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:17.004994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.005439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.005853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:17.131406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:17.138987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7f114073-da69-4b65-ac42-52e83d41b24c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.146070 Sep 12 14:17:17.139548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 285/565] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:16 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:17.308582 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:17.309232 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:17.315931 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.316411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.316846 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:17.317532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.317983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.318403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:17.381958 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:17.389484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-470d0825-591c-4562-a58e-32ccf9d5c89a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1291 microversion: 2.1 time: 0.084697 Sep 12 14:17:17.390052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 281/566] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:17 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1291 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:17.914419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:17.915065 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:17.922176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.922670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.923114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:17.923803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:17.924256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:17.924679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:18.047290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:18.055445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1a91f69c-fe48-4346-b8f0-e38858719c38 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.144851 Sep 12 14:17:18.056011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 286/567] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:17 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:18.161888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:18.162424 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:18.168802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:18.169277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:18.169702 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:18.170377 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:18.170818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:18.171919 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:18.303921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:18.311717 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83b870a3-dd5c-4bec-b5e9-f5bbde902653 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.153502 Sep 12 14:17:18.312285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 282/568] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:18 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:18.411851 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:18.412537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:18.419256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:18.419745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:18.420244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:18.420940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:18.422011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:18.422438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:18.484097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:18.491510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-290da7eb-4733-48c3-b54a-ddda7b317bce tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1291 microversion: 2.1 time: 0.083447 Sep 12 14:17:18.492071 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 287/569] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:18 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:19.079239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:19.079879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:19.085771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.086281 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.086715 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.087442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.087895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.088317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.212083 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:19.220841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bfb65986-2aa0-45ee-9a25-8055d8381a68 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.145451 Sep 12 14:17:19.221415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 283/570] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:19 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:19.334768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:19.335353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:19.341761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.342244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.342678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.344045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.344505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.344922 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.472567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:19.480362 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e9d5d75c-9b02-48a3-a0c5-734f3743e1ef tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1678 microversion: 2.1 time: 0.149520 Sep 12 14:17:19.480934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 288/571] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:19 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:19.513387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:19.514028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:19.520401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.520878 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.521310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.521987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:19.522444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:19.522891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:19.585233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:19.592866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69a0355f-7272-44ce-9a3d-062a6831b9fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1291 microversion: 2.1 time: 0.083334 Sep 12 14:17:19.593432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 284/572] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:19 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1291 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:20.245249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:20.245871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:20.255191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.255679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.256118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.256923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.257382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.259520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.453262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:20.461318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3362a3c0-b9b0-4fa4-b81c-da2ce55cca1a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.220379 Sep 12 14:17:20.461942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 289/573] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:20 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:20.502976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:20.503586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:20.509785 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.510258 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.510689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.511390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.511838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.512253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.615677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:20.616282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:20.622270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.622859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.623294 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.623974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.624960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.625364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.723496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:20.731198 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c00e2bd1-b8fa-468e-a84f-73254b7c236f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1291 microversion: 2.1 time: 0.119379 Sep 12 14:17:20.731842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 290/574] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:20 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1291 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:20.758507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:20.766170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdff6a26-f8d2-4011-8d7e-e4c0a616137f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1655 microversion: 2.1 time: 0.267005 Sep 12 14:17:20.766730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 285/575] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:20 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1655 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:20.788131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:20.793953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.794427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.794872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.817316 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Going to try to start instance {{(pid=120624) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 14:17:20.856423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d076e9b0-ac12-4bca-b153-595c39494a70 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action" status: 202 len: 0 microversion: 2.1 time: 0.071990 Sep 12 14:17:20.857060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 291/576] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:17:20 2022] POST /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:20.865442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:20.866056 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:20.871928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.872407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.872847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:20.873527 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:20.873980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:20.875081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:21.012540 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:21.020442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-614695fd-21c9-4dc2-80fe-d2a1f88c25dc tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1664 microversion: 2.1 time: 0.158650 Sep 12 14:17:21.021672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 286/577] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:20 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:21.485830 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:21.486531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:21.492700 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:21.493177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:21.493611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:21.494293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:21.494743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:21.495189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:21.625212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:21.627871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:21.636007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0d9ef672-3fb2-4f5d-995e-e986dc049555 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.154890 Sep 12 14:17:21.636585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:21 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:21.754139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:21.754672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:21.761071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:21.761547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:21.761972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:21.762649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:21.763128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:21.763544 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:21.824478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:21.832693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6a482b8-869c-411e-8542-f032510823ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1299 microversion: 2.1 time: 0.082502 Sep 12 14:17:21.833264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 287/579] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:21 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:22.044581 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:22.045210 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:22.052238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.052704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.053126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.053794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.054238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.181320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:22.189231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c6ff199d-7eb3-49af-a1b5-47a43cbc40b0 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1664 microversion: 2.1 time: 0.148774 Sep 12 14:17:22.189788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 293/580] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:22 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:22.659692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:22.660232 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:22.666184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.666663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.667130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.667842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.668294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.668714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.671302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:22.798382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:22.806569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0b70ff9-4db2-44bb-9c5d-8306e2824c05 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.151007 Sep 12 14:17:22.807164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 288/581] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:22 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:22.855262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:22.855874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:22.862176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.862655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.863119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.863803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:22.864252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:22.864673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:22.927379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:22.934883 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d250ab7b-f216-4961-974a-0ba5aa39941c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1299 microversion: 2.1 time: 0.083404 Sep 12 14:17:22.935448 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 294/582] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:22 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:23.212633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:23.213237 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:23.219187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.219659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.220087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.220762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.221238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.221655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.357093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:23.365657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3599adc0-856f-45e6-b250-6c0662222aae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1664 microversion: 2.1 time: 0.156809 Sep 12 14:17:23.366222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 289/583] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:23 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:23.829749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:23.830355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:23.836440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.836881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.837310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.837997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.838443 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.838885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.958398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:23.959106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:23.965422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.965544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:23.965968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.966325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.967051 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:23.967509 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:23.967930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:23.973944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-120d07e9-2f8a-4180-9b41-22a9782a922d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1731 microversion: 2.1 time: 0.148094 Sep 12 14:17:23.974674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 295/584] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:23 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:24.029304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:24.037145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5d98606d-5e93-4b78-b4f7-1dd34b886ff4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1299 microversion: 2.1 time: 0.082861 Sep 12 14:17:24.037711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 290/585] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:23 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:24.388843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:24.389460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:24.395432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:24.395917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:24.396825 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:24.397045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:24.397503 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:24.397934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:24.527894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:24.536031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20831ebb-f5a3-48d1-bd6e-a2afea8c7f63 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1664 microversion: 2.1 time: 0.151418 Sep 12 14:17:24.536597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 296/586] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:24 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:24.999142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:24.999760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.006889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.007554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.008072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.008821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.009352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.009779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.060600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:25.061847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.065923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:25.070563 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:25.090000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.091962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.093945 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.094893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.098769 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.099243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.160378 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:25.173804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89165753-7684-4286-9775-fcfd64fdcd55 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1711 microversion: 2.1 time: 0.179708 Sep 12 14:17:25.174698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 291/587] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:24 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1711 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:25.293973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:25.306981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a943396e-e8bf-4f02-8dc9-46c4c99937e6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.248121 Sep 12 14:17:25.307852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 297/588] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:25 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:25.325443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:25.326015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.328120 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:25.335125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.336266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.336447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.337282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.337728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.338288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.424629 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] HTTP exception thrown: Cannot 'detach_volume' instance eb689d73-c89d-4341-9742-b8b4005976dc while it is in vm_state rescued Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Request method failure captured: Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments/e2c83b48-e80b-4594-b916-07634dcab7a6 HTTP/1.1 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6HAqeH4uA3THeEGY66TmW5JFBqWWE6VpSBn2DgT2hzfK6cFQaPP-DmHN_WeZH75AWmbdIxbQcEkPjoMLx-9xqcmEh2mxfQhVnpA9e5v8hXSpDeNE-mwuUeutYx92Xui3Up3pd3VwO8qGdy7u_VzHkty0JwerxP-SgskOZlk6dGQsE Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:17:25.426474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366826b14e0e4a93819c18d8d716a254", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 5f2ff5e497b64e49b7ac25a941a06048 Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:17:25.427929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Cannot 'detach_volume' instance eb689d73-c89d-4341-9742-b8b4005976dc while it is in vm_state rescued Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'server_id': 'eb689d73-c89d-4341-9742-b8b4005976dc', 'id': 'e2c83b48-e80b-4594-b916-07634dcab7a6'} Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eb689d73-c89d-4341-9742-b8b4005976dc in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:17:25.428639 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eb689d73-c89d-4341-9742-b8b4005976dc while it is in vm_state rescued Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eb689d73-c89d-4341-9742-b8b4005976dc while it is in vm_state rescued Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:25.430139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Returning 409 to user: Cannot 'detach_volume' instance eb689d73-c89d-4341-9742-b8b4005976dc while it is in vm_state rescued {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:17:25.431382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67628430-7bad-4cfe-a70e-dbdc11d1b4e6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments/e2c83b48-e80b-4594-b916-07634dcab7a6" status: 409 len: 152 microversion: 2.1 time: 0.107406 Sep 12 14:17:25.432118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 292/589] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:17:25 2022] DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments/e2c83b48-e80b-4594-b916-07634dcab7a6 => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 14:17:25.437727 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:25.438440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.445306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.445970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.446714 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.447585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.448182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.448770 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.536630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4da4eece-0821-4601-8177-a494c6156170 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/action" status: 202 len: 0 microversion: 2.1 time: 0.103090 Sep 12 14:17:25.538295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 298/590] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:17:25 2022] POST /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:17:25.547083 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:25.547710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.554029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.554540 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.555188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.555928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.556534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.557179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.563519 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:25.564622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:25.571865 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.572483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.573045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.573850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:25.574449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:25.574971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:25.869723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:25.878219 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9cede635-2ad3-488e-99cb-7c3aec527c92 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1719 microversion: 2.1 time: 0.335511 Sep 12 14:17:25.878805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 293/591] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:25 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1719 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:25.891033 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:25.899573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3ca41d61-c548-41cb-a8be-06f4a906ba12 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1664 microversion: 2.1 time: 0.341402 Sep 12 14:17:25.900314 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 299/592] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:25 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1664 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:26.333352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:26.333968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:26.340647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.341133 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.342168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.343044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.343568 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.343994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.560166 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:26.569189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-737bd1e3-2523-4796-ad75-053409bc0e53 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.239725 Sep 12 14:17:26.577560 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 294/593] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:26 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:26.622085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8856b-07c8-4b63-8ab0-f22e2be080a6", "tag": "0e35527d-008f-43d4-89a7-ebd020d16331"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:26.634046 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.634605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.635128 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.646745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] Creating event network-changed:0e35527d-008f-43d4-89a7-ebd020d16331 for instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 on hv-cinder-82002 Sep 12 14:17:26.652353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-0ff0ec88-485f-46f1-9f5e-ffa70a36fba5 req-80061852-05f6-40f5-aca6-ea03d6bebd80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034691 Sep 12 14:17:26.653018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 300/594] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:26.901711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:26.902444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:26.908947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.909427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.909864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.910550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.911053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.911477 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.924482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:26.925169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:26.931289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.931764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.932188 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:26.932900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:26.933348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:26.933763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:27.104000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:27.110525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:27.112544 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85bdc6b8-e76d-4518-8587-47b98b25ea09 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1719 microversion: 2.1 time: 0.214649 Sep 12 14:17:27.113252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 295/595] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:26 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:27.118483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ff6751cb-527d-4de1-8c58-0176623ca11a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1668 microversion: 2.1 time: 0.198825 Sep 12 14:17:27.119067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 301/596] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:26 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1668 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:27.591889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:27.592501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:27.599001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:27.599484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:27.599917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:27.600611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:27.601279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:27.601696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:27.736549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:27.744201 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0639a6d8-5e05-4a72-9dc2-05b5723d419c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.156082 Sep 12 14:17:27.744775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 296/597] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:27 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:28.141203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:28.141814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:28.148312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.148782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.149208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.149880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.150326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.150740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.282060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:28.290194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-99d88594-dd06-45b7-a081-4bc6eb2efe37 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1719 microversion: 2.1 time: 0.153067 Sep 12 14:17:28.290753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 302/598] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:28 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:28.613460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:28.613945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:28.620482 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.620968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.621405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.622126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.622579 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.623030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.701635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lazy-loading 'services' on Instance uuid b62c251a-73a8-4862-b62f-23dee73e3239 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:28.767957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:28.768570 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:28.775014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.775500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.775929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.776618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:28.777070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:28.777491 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:28.782049 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1768a63b-ee62-4f38-b403-1dab34aa6cf8 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239/os-volume_attachments/914d279e-10ae-4881-9bc5-3599ba024241" status: 202 len: 0 microversion: 2.1 time: 0.172344 Sep 12 14:17:28.782888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 297/599] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:17:28 2022] DELETE /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239/os-volume_attachments/914d279e-10ae-4881-9bc5-3599ba024241 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:28.920099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:28.932183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-234bd28b-a085-4d3c-990d-75ba4017578a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.168093 Sep 12 14:17:28.933036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 303/600] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:28 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:29.314312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:29.315062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:29.321189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.321664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.322093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:29.322767 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.323248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.323666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:29.462670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:29.471018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58601616-f255-4a4f-bd73-2423f39cb208 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1725 microversion: 2.1 time: 0.161622 Sep 12 14:17:29.471580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 298/601] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:29 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:29.493536 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:29.494036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:29.500993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.501475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.501914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:29.502601 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.503093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.503519 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:29.583546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b62cf999-08bc-48eb-b2b5-4b684bbd4bba tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093782 Sep 12 14:17:29.584153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 304/602] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:17:29 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:29.957170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:29.958460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:29.965165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.965728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.966232 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:29.967204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:29.967723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:29.968390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:30.109911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:30.118185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35b739bb-68b9-4738-a115-e3283aa65f11 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.165993 Sep 12 14:17:30.119195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 299/603] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:29 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:30.752091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:30.762018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:30.762960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:30.763631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:30.776194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] Creating event network-changed:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:17:30.782149 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2a14b3c8-f39f-4e35-994a-18a02f2e44a8 req-3af847a2-de0c-4efc-92d2-f2cbf2ce4cd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Sep 12 14:17:30.782762 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 305/604] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:17:30.969778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:30.970271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:30.976673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:30.977162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:30.977594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:30.978287 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:30.978740 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:30.979268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:31.004943 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:17:31.080042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac15c84f-e52c-4204-84d2-fcd54c257f09 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 204 len: 0 microversion: 2.1 time: 0.114450 Sep 12 14:17:31.080755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 300/605] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:17:30 2022] DELETE /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:17:31.089529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:31.090229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:31.097381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:31.097864 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:31.098297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:31.099028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:31.099481 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:31.099904 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:31.145298 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:31.146220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:31.152392 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:31.152947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:31.153473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:31.154393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:31.154949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:31.156051 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:31.277767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:31.286201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d72a8f07-51d1-4e10-b452-ea77fb0657b1 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1513 microversion: 2.1 time: 0.200893 Sep 12 14:17:31.287028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 306/606] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:31 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:31.320549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:31.328778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31b02a57-5208-4916-814b-74b68c51a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.188054 Sep 12 14:17:31.329333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 301/607] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:31 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:32.309592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:32.310208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:32.317402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:32.317883 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:32.318315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:32.319034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:32.319483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:32.319910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:32.351030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:32.352226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:32.359423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:32.359904 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:32.360328 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:32.361011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:32.361458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:32.361874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:32.377791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:32.496987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:32.505398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-886cbe7d-35e4-44da-a15b-abc5eedf77c4 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1513 microversion: 2.1 time: 0.199706 Sep 12 14:17:32.505979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 307/608] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:32 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:32.522392 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:32.530196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f337457-6371-4c5d-a4da-5a7405b7f4fd tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.182939 Sep 12 14:17:32.530758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 302/609] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:32 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:32.796990 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:32.806127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:32.806599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:32.807059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:32.817977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] Creating event network-changed:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:17:32.823101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-511d70e1-54d2-430d-a2cb-c4255701ce48 req-62799a30-3aff-4e92-90cf-e49b4352c5c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030328 Sep 12 14:17:32.823689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 308/610] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:33.528349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:33.529081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:33.531391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:33.536323 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:33.536805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:33.537239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:33.537929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:33.538378 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:33.538801 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:33.553899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:33.555120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:33.562129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:33.563317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:33.569645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:33.570584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:33.574709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:33.575223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:33.751115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:33.760073 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f2712810-fddb-482f-8ba5-899fafc05397 tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1513 microversion: 2.1 time: 0.235487 Sep 12 14:17:33.760848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 303/611] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:33 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:33.769891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:33.778226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fe2a82f2-c329-4653-a591-9646775af514 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.229041 Sep 12 14:17:33.778784 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 309/612] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:33 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:34.316808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62c251a-73a8-4862-b62f-23dee73e3239", "name": "network-vif-deleted", "tag": "707f49d3-a873-4bc2-9e47-7281fb27da2b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:34.330557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.332179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.333186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.346163 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] Creating event network-vif-deleted:707f49d3-a873-4bc2-9e47-7281fb27da2b for instance b62c251a-73a8-4862-b62f-23dee73e3239 on hv-cinder-82002 Sep 12 14:17:34.351027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-984d0235-83d8-49b9-904e-cd90bb28418f req-483be1b8-1d9d-47cb-ab56-2c1f827e2a63 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037918 Sep 12 14:17:34.351822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 304/613] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:34.784577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:34.785178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:34.791745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.792258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.792688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.793370 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.793821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.795329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.802318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:34.802978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:34.808928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.809403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.809828 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.810501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.810978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.811389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.825574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:34.830676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:34.830676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:34.831123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:34.831572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lazy-loading 'fault' on Instance uuid b62c251a-73a8-4862-b62f-23dee73e3239 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:34.833889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:34.901847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02fd338d362a461a846a454c487bf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34866fb3f98042d38c922bf3552c4e69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:34.911357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c9ef80eb-fcdf-4b1c-9fcc-ae64320ca51b tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 200 len: 1308 microversion: 2.1 time: 0.131110 Sep 12 14:17:34.912024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 310/614] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:34 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:34.968554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:34.976226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aef42883-5275-4bf7-adae-ebb12757a241 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.178922 Sep 12 14:17:34.976797 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 305/615] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:34 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:35.016984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e8856b-07c8-4b63-8ab0-f22e2be080a6", "name": "network-vif-plugged", "status": "completed", "tag": "0e35527d-008f-43d4-89a7-ebd020d16331"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:35.026554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:35.027077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:35.027562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:35.038606 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] Creating event network-vif-plugged:0e35527d-008f-43d4-89a7-ebd020d16331 for instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 on hv-cinder-82002 Sep 12 14:17:35.043487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-89346dc7-354d-47bc-a0b3-302ad7167f97 req-df3f3fd0-f0ee-4117-bc1b-a238b7286969 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 Sep 12 14:17:35.044649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 311/616] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:35.934059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:35.934664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] [instance: b62c251a-73a8-4862-b62f-23dee73e3239] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:35.941373 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:35.941847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:35.942273 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:35.942972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:35.943422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:35.943838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:35.956736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] HTTP exception thrown: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Request method failure captured: Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 HTTP/1.1 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz7y3sCzO2BNGK6BjDGQO-x6_3m0Ja3KcsFE2tGP1k9bZ61hdcMNq-_WmOLk_2NzypKpYRMw1CTFAFqx-yO2lxOEmTQsM82JuBT_N85tuoe3VnKGz1v1EIuGNXcAVDxh11VhJf7TPNoTY-1UvgpUaRH86i7hfRsdHaQtpelY6eX8QX4 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 34866fb3f98042d38c922bf3552c4e69 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:17:35.958330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34866fb3f98042d38c922bf3552c4e69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34866fb3f98042d38c922bf3552c4e69", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 34866fb3f98042d38c922bf3552c4e69 Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-948357311 Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotTestJSON-948357311-project Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 02fd338d362a461a846a454c487bf669 Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotTestJSON-948357311-project Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. Sep 12 14:17:35.959802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'b62c251a-73a8-4862-b62f-23dee73e3239'} Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:17:35.960666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. Sep 12 14:17:35.962095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:17:35.963465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] Returning 404 to user: Instance b62c251a-73a8-4862-b62f-23dee73e3239 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:17:35.963465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b25176d6-2a06-4a90-9587-3a446d9f39ca tempest-VolumesSnapshotTestJSON-948357311 tempest-VolumesSnapshotTestJSON-948357311-project] 10.222.0.42 "GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239" status: 404 len: 111 microversion: 2.1 time: 0.029464 Sep 12 14:17:35.963465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 306/617] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:35 2022] GET /compute/v2.1/servers/b62c251a-73a8-4862-b62f-23dee73e3239 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:17:36.005805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:36.006505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:36.012595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:36.013070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:36.013499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:36.014208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:36.014663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:36.015250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:36.147023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:36.155805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5eabf42a-a008-4d3e-8349-b936c2708697 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1365 microversion: 2.1 time: 0.154124 Sep 12 14:17:36.156556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 312/618] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:35 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:37.180755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:37.181289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:37.188436 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:37.188905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:37.189333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:37.190007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:37.190452 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:37.190883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:37.318583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:37.326261 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44fde74a-0522-4e05-ab9d-b9b07e8412e7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1556 microversion: 2.1 time: 0.149447 Sep 12 14:17:37.327501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 307/619] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:37 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:37.349659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:37.350182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:37.356740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:37.357226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:37.357662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:37.358349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:37.358799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:37.359270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:37.437706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-387ec3aa-316f-4e35-b7d3-828a4271bd34 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091660 Sep 12 14:17:37.447338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 313/620] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:17:37 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:38.589139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8856b-07c8-4b63-8ab0-f22e2be080a6", "tag": "0e35527d-008f-43d4-89a7-ebd020d16331"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:38.599643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:38.600116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:38.600543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:38.611882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] Creating event network-changed:0e35527d-008f-43d4-89a7-ebd020d16331 for instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 on hv-cinder-82002 Sep 12 14:17:38.617057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a4d44c70-0c73-4f5a-83c1-de2fb7e75d45 req-a568a759-f8a8-410a-8109-8742c9f70cf6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Sep 12 14:17:38.617793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 308/621] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:43.855783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:43.858485 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:43.864387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:43.864881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:43.865303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:43.865972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:43.866414 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:43.866825 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:43.936815 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-116897e8-917f-4984-9d67-acb4be3e35e6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action" status: 202 len: 0 microversion: 2.1 time: 0.084611 Sep 12 14:17:43.938513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 314/622] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:17:43 2022] POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:17:43.946996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:43.947711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:43.954081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:43.954718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:43.955260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:43.956067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:43.956610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:43.957053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:44.105388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:44.114770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b0a69ff-7616-43af-9c9b-962a75281d38 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1753 microversion: 2.1 time: 0.172574 Sep 12 14:17:44.115371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 309/623] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:43 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:45.139379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:45.140100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:45.146190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:45.146663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:45.147115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:45.147791 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:45.148235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:45.148651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:45.287155 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:45.295831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9829a05b-402b-4974-8adf-dc875370f166 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.160747 Sep 12 14:17:45.296387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 315/624] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:45 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:46.319414 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:46.320026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:46.327127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:46.327599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:46.328025 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:46.328700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:46.329142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:46.329556 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:46.477100 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:46.485212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cecac7b3-7ac5-4612-ad2d-dca20edbf448 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.169596 Sep 12 14:17:46.485774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 310/625] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:46 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:47.508537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:47.509195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:47.516192 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:47.516666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:47.517092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:47.517766 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:47.518212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:47.518625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:47.657059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:47.665162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3affce6e-7fd4-4826-abf7-8a3c84d7a479 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.160471 Sep 12 14:17:47.665712 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 316/626] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:47 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:48.688486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:48.689228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:48.696298 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:48.696789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:48.697230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:48.697933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:48.698389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:48.698874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:48.836952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:48.845218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72191da6-7606-4557-acbd-b4aad65e6130 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.161208 Sep 12 14:17:48.845788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 311/627] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:48 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:17:49.869499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:49.870111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:49.877353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:49.877829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:49.878252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:49.878958 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:49.879411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:49.879819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:50.046037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:50.054691 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-52b46af1-8d14-4e5b-a8fb-6f8b7f84ab59 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.189709 Sep 12 14:17:50.055289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 317/628] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:49 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:51.077420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:51.078647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:51.085096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:51.085416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:51.085893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:51.086528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:51.087003 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:51.087418 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:51.237713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:51.246337 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bff089df-48b4-4728-9f6b-9faa1b6fb8b6 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.172722 Sep 12 14:17:51.246941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 312/629] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:51 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:52.269214 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:52.269829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:52.276194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:52.276664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:52.277092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:52.277817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:52.278266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:52.278711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:52.427962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:52.436137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0862756b-4a06-4ae1-bc4a-dc92959797a3 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.170761 Sep 12 14:17:52.436697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 318/630] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:52 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:53.459419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:53.460045 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:53.466307 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.466862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.467367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:53.468180 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.468676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.469136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:53.615454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:53.623674 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f76f413-643b-40b6-8fec-acc2200a2661 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.168093 Sep 12 14:17:53.624242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 313/631] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:53 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:53.845752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:53.846246 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:53.852643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.853121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.853553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:53.854232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.854680 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.855124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:53.883983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-37c09012-46ee-437b-bcb9-f29fe0ebb567 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments/68b257bd-3a0b-4361-8269-f72679b5eb82" status: 200 len: 194 microversion: 2.20 time: 0.042132 Sep 12 14:17:53.884495 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 319/632] 10.222.0.42 () {60 vars in 1454 bytes} [Mon Sep 12 14:17:53 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments/68b257bd-3a0b-4361-8269-f72679b5eb82 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:17:53.951216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:53.951727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:53.958243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.958724 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.959194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:53.959875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:53.960323 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:53.960742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:54.042479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lazy-loading 'services' on Instance uuid 124f260e-ab17-46a8-a63d-33ee552dbac2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:54.114416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6cfcd352-f68b-4339-821e-4fe65b0fcc24 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments/68b257bd-3a0b-4361-8269-f72679b5eb82" status: 202 len: 0 microversion: 2.20 time: 0.166991 Sep 12 14:17:54.115039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 314/633] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Sep 12 14:17:53 2022] DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments/68b257bd-3a0b-4361-8269-f72679b5eb82 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:17:54.123499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:54.126411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:54.133024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:54.133512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:54.133949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:54.134780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:54.135244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:54.135666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:54.165029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-abcd0ecf-65d2-4666-a1a2-7497afd5fab5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045566 Sep 12 14:17:54.165591 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 320/634] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 12 14:17:54 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:17:54.648587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:54.649290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:54.660031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:54.660031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:54.660031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:54.660031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:54.660417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:54.660417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:54.806320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:54.814945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d35d73f6-7c05-4c2b-b092-a594d046f3c7 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.171845 Sep 12 14:17:54.815489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 315/635] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:54 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:55.176858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:55.179015 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:55.185348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.185821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.186249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.186948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.187652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.188573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.216905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6c2cf45c-0cff-48fd-a54d-f68b2997af5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044004 Sep 12 14:17:55.217450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 321/636] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 12 14:17:55 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:55.278280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:55.278803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:55.284788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.285313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.285736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.286439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.286925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.287348 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.311802 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:17:55.387812 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce1628d4-648e-44cf-9d89-34405a456c01 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 204 len: 0 microversion: 2.20 time: 0.113190 Sep 12 14:17:55.388644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 316/637] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 12 14:17:55 2022] DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 14:17:55.397874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:55.398540 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:55.404533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.405007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.405431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.406104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.406553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.407023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.539793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:55.548247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:55.549707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:55.550905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a73f8605-2a85-4d2c-8aa5-c36dc630af7b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.156887 Sep 12 14:17:55.551463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 322/638] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:55 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:55.837955 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:55.838666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:55.845149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.845628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.846061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.846750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:55.847225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:55.847648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:55.991499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:56.000124 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dce518a1-228e-49f4-bf7b-c255fd269884 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.166317 Sep 12 14:17:56.000703 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 317/639] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:55 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:56.577056 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:56.577685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:56.584572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:56.585045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:56.585470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:56.586142 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:56.586582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:56.587028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:56.711345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:56.719398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:56.720827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:56.721971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-17b4b930-6520-4084-a3a1-459841efbfbb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1722 microversion: 2.20 time: 0.148822 Sep 12 14:17:56.722525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 323/640] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:56 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:57.025312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:57.025926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:57.032439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:57.032946 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:57.033377 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:57.034087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:57.034530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:57.034973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:57.174315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:57.176664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:17:57.183614 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9947acd-2b53-4685-94f5-7d61395ae8e2 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.162060 Sep 12 14:17:57.184225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 318/641] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:57 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:57.748852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:57.749459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:57.762715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:57.763234 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:57.763668 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:57.764365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:57.764998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:57.765447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:57.831535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:57.840103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:57.841504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:57.842675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ae13bf28-c5ec-4400-952b-d3747754fb69 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1654 microversion: 2.20 time: 0.097754 Sep 12 14:17:57.843285 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 324/642] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:57 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:58.015128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f260e-ab17-46a8-a63d-33ee552dbac2", "name": "network-vif-deleted", "tag": "973fcd9c-f68f-4124-bfa1-66c0b9ab5c63"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:17:58.030198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.030914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.031327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.045631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] Creating event network-vif-deleted:973fcd9c-f68f-4124-bfa1-66c0b9ab5c63 for instance 124f260e-ab17-46a8-a63d-33ee552dbac2 on hv-cinder-82002 Sep 12 14:17:58.050605 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0c812247-75c7-4c3e-ac52-0d468df6d184 req-bbdebf22-7398-48e0-b70c-11fd4cf25931 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041185 Sep 12 14:17:58.051252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 319/643] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:17:58.208397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:58.209016 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:58.215203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.215692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.216311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.217001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.217618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.218038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.381725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:58.393452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-aada74d3-5dd7-481f-bb12-35bf6fb57ebd tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.189101 Sep 12 14:17:58.394424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 325/644] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:58 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:58.869226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:58.869981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:58.877840 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.878344 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.878779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.879508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.879962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.880391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.915817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:58.916310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:58.916966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:58.917480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lazy-loading 'fault' on Instance uuid 124f260e-ab17-46a8-a63d-33ee552dbac2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:17:58.961380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:58.969305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:58.970758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:58.971947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70b5cc31-49c1-4468-8a6b-d6b6131da30e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 200 len: 1371 microversion: 2.20 time: 0.107422 Sep 12 14:17:58.972513 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 320/645] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:58 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:17:59.417870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:59.418511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:17:59.427455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:59.427979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:59.428508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:59.429462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:17:59.430530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:17:59.431187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:17:59.580880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:17:59.589122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fb7178dd-cef6-4981-b8ad-8293077987a4 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.175120 Sep 12 14:17:59.589697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 326/646] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:17:59 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:17:59.997128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:17:59.997732 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:00.004294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:00.004769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:00.005198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:00.005887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:00.006403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:00.006824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:00.020555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 HTTP/1.1 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:00.022263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:18:00.023807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '124f260e-ab17-46a8-a63d-33ee552dbac2'} Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:00.024649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:18:00.025884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:00.027046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:00.027046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b920e25f-7ecf-4a72-adb5-731d06905239 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 404 len: 111 microversion: 2.20 time: 0.030527 Sep 12 14:18:00.027046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 321/647] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:17:59 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:18:00.033688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0872468d-dd65-4fda-9bbe-af1762733fd8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '.version_select at 0x7f75607fc8b0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:00.053867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0872468d-dd65-4fda-9bbe-af1762733fd8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525560368" status: 204 len: 0 microversion: 2.20 time: 0.024627 Sep 12 14:18:00.054637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 327/648] 10.222.0.42 () {60 vars in 1259 bytes} [Mon Sep 12 14:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525560368 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 14:18:00.613360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:00.613900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:00.619871 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:00.620357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:00.620790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:00.621489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:00.621944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:00.622367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:00.833178 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:00.841575 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-660a50ba-e7ad-4f78-a34f-60ba1e721c96 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1758 microversion: 2.1 time: 0.232371 Sep 12 14:18:00.842143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 322/649] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:00 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1758 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:00.978055 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd8a402e-75c3-494a-a1d7-4fdc70988ee9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: .version_select at 0x7f75607ec310>, body: {"keypair": {"name": "tempest-keypair-1388239123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2is1BeECNguNraEX7C+6NpS1HB340Skkmaz/fihlfZdfGBkp0aIMBNc8NVwuTfWduBB46FlRlWfSOwUydUGAv04TTs3mqkxheeBDJoyWGbCWvLbsTV6zy07oU8lj6WgQ=="}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:00.996101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-fd8a402e-75c3-494a-a1d7-4fdc70988ee9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:01.002602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-fd8a402e-75c3-494a-a1d7-4fdc70988ee9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for user 0cafcc70e0e74a5fa7c5ce530e0e848f and project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'key_pairs'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:01.036472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd8a402e-75c3-494a-a1d7-4fdc70988ee9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.061970 Sep 12 14:18:01.037292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 328/650] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Sep 12 14:18:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 14:18:01.864697 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:01.865343 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:01.871791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:01.872272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:01.872708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:01.873404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:01.873856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:01.874277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:02.020114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:02.028412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a77debdd-d09f-4eb7-91f4-4ec0e74ac621 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1761 microversion: 2.1 time: 0.167618 Sep 12 14:18:02.028976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 323/651] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:01 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:02.515451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-612664602", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96bd5f8d-099c-4d46-b564-f8ab0058d9c3"}], "security_groups": [{"name": "tempest-securitygroup--72246232"}], "key_name": "tempest-keypair-1388239123", "user_data": "}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:02.619402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] validate_networks() for [('96bd5f8d-099c-4d46-b564-f8ab0058d9c3', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:18:02.971147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:18:02.971512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:18:02.971980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:18:02.972389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:18:02.972796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:18:02.981431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:02.981909 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:02.982338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:02.983098 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:02.983553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:02.983974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:02.991230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:03.003342 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:03.007813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Getting quotas for user 0cafcc70e0e74a5fa7c5ce530e0e848f and project 701f62e5a7b14dfc86f2dcc5aa39d958. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:03.019134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:18:03.021397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:18:03.066816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-31021ff0-8efe-4872-85af-8231e2541c37 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.556154 Sep 12 14:18:03.067489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 329/652] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Sep 12 14:18:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 14:18:03.079079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:03.079688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:03.134166 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:03.142277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:03.143843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:03.144984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a97ed3e-2cdd-469e-8fdf-a2b6ee7e7702 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1281 microversion: 2.20 time: 0.070345 Sep 12 14:18:03.145540 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 324/653] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:03 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:18:04.170389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:04.170974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:04.178233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:04.178715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:04.179174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:04.179860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:04.180312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:04.180731 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:04.242317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:04.250912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:04.252418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:04.253568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1ba9d2b2-6d37-47a6-b9c5-c62711c52865 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1333 microversion: 2.20 time: 0.087649 Sep 12 14:18:04.254127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 330/654] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:04 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:05.278313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:05.278940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:05.282774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:05.288019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:05.288732 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:05.289165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:05.289861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:05.290313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:05.290731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:05.424433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:05.432779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:05.434221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:05.435367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-823ce92d-0409-419e-9a08-a7bc921ed165 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.161374 Sep 12 14:18:05.436135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 325/655] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:05 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:05.661998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:05.669038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:05.675224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:05.675697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:05.676121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:05.689631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] Creating event network-changed:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:18:05.695514 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e8a38afc-40d1-47cb-9ad3-cd42ce08d0d5 req-79fd05df-f0b5-4386-9f0b-a38c6750fce9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036849 Sep 12 14:18:05.696119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 331/656] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:06.462148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:06.462811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:06.469797 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:06.470278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:06.470714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:06.471438 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:06.471897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:06.472323 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:06.599864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:06.608459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:06.610465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:06.611683 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e357209-2901-4ce8-9dc9-448849f7424a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.153537 Sep 12 14:18:06.612249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 326/657] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:06 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:07.636956 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:07.637651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:07.646156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:07.646636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:07.647096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:07.647782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:07.648231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:07.648651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:07.775111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:07.783136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:07.784559 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:07.785661 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ca30244d-1e96-43d0-95b2-2d45c2da3701 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.153027 Sep 12 14:18:07.786220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 332/658] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:07 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:08.810246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:08.810883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:08.818098 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:08.818575 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:08.819034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:08.819721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:08.820175 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:08.820597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:08.948145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:08.956728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:08.958183 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:08.959327 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4a3b1c1-fb51-4422-8e05-81d356734f56 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.152936 Sep 12 14:18:08.959890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 327/659] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:08 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:09.983789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:09.984397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:09.990758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:09.991263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:09.991694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:09.992366 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:09.992849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:09.993260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:10.274987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:10.282913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:10.284333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:10.285452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b4704fc3-bcf7-495f-8953-769677c40ee5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.305553 Sep 12 14:18:10.286003 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 333/660] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:09 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:11.195918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "name": "network-vif-plugged", "status": "completed", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:11.205803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:11.206277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:11.206733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:11.218093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] Creating event network-vif-plugged:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:18:11.223635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b981678c-2d67-43f2-9d02-ba26de601b5f req-7c407a6e-4012-4bf1-8cad-887ba91f1f36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Sep 12 14:18:11.224228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 328/661] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:11.309916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:11.310706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:11.317808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:11.318293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:11.318740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:11.319463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:11.319912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:11.320323 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:11.462598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:11.472036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:11.473508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:11.474604 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a819ba98-df2c-410e-9ae9-1c1e29635ea6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.168637 Sep 12 14:18:11.475195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 334/662] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:11 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:11.751432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:11.752007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:11.758020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:11.758492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:11.758949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:11.759622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:11.760068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:11.760483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:11.839784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'services' on Instance uuid eb689d73-c89d-4341-9742-b8b4005976dc {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:12.006824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4d239ea-5519-42f4-92ef-fc246bc3a1b9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments/e2c83b48-e80b-4594-b916-07634dcab7a6" status: 202 len: 0 microversion: 2.1 time: 0.259981 Sep 12 14:18:12.007441 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 329/663] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:18:11 2022] DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments/e2c83b48-e80b-4594-b916-07634dcab7a6 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:12.015827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:12.018042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:12.023940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:12.024416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:12.024849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:12.025537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:12.025988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:12.026410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:12.056840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6dcb5517-b0ae-4cce-823a-17983bce225e tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Sep 12 14:18:12.057372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 335/664] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:12 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:12.500087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:12.500817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:12.506999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:12.507474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:12.507902 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:12.508585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:12.509033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:12.509447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:12.636095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:12.644035 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:12.645465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:12.646552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7c15b14-7b4e-4ca0-bb25-c1f8614756ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1405 microversion: 2.20 time: 0.151186 Sep 12 14:18:12.647131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 330/665] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:12 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:13.069407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:13.071592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:13.073956 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:13.074708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=10 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:13.081473 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.081943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.082369 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.083067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.083512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.083933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.113705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9f0241c6-a190-486f-a639-24e9ffa9c25c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Sep 12 14:18:13.114187 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 336/666] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:13 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:13.671988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:13.673022 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:13.675074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:13.680855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.681333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.681768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.682459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.682937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.683357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.809145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:13.818123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:13.819588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:13.820731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c09d476-dee9-49b2-9310-36ecbaa56b15 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1596 microversion: 2.20 time: 0.152969 Sep 12 14:18:13.821285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 331/667] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:18:13 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1596 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:18:13.845490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:13.845974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:13.851803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.852279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.852710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.853382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:13.853824 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:13.854237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:13.934036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dbe49142-7e56-46f5-82c6-20e277637940 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092941 Sep 12 14:18:13.934627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 337/668] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Sep 12 14:18:13 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:18:14.126158 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:14.128712 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:14.135288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.135793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.136229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.136915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.137399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.137817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.167118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ada3a72c-aab9-4764-b9e7-ec691e390ae6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044848 Sep 12 14:18:14.167677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 332/669] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:14 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:18:14.246236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:14.246770 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:14.252751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.253231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.253950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.254646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.255254 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.255677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.286308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:14.362403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-82627167-8078-4690-83e0-3ea6885ab5b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 204 len: 0 microversion: 2.1 time: 0.120223 Sep 12 14:18:14.363577 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 338/670] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:14 2022] DELETE /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:18:14.371696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:14.372486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:14.379869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.380354 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.380793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.381484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.381937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.382355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.629603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:14.637397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db20e67e-2a60-4057-a504-9f1cf6639d89 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.269942 Sep 12 14:18:14.637965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 333/671] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:14 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:14.925017 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:14.934421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:14.934920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:14.935352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:14.947100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] Creating event network-changed:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:18:14.951982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-c4c38257-a695-4c32-9d2d-3df50527f469 req-b0c51edd-795d-4e4c-a5ff-83e3702cdff3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031035 Sep 12 14:18:14.952741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 339/672] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:15.103277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:15.105473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:15.112245 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.112718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.113143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.113822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.114263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.114679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.145442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46646fc2-5845-411a-969b-650da3636272 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046030 Sep 12 14:18:15.145997 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 334/673] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:15 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:18:15.209965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:15.210622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:15.216881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.217493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.217993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.218760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.219340 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.219836 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.245695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:15.320632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7d56738b-0c4b-4ed6-9887-714b48e216b1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 204 len: 0 microversion: 2.1 time: 0.114759 Sep 12 14:18:15.321312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 340/674] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:15 2022] DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:18:15.329354 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:15.329958 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:15.335809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.336302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.336941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.337570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.338027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.338450 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.467998 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:15.477683 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-176b9ebc-3d9d-4b53-bd60-cf6617ecce15 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1674 microversion: 2.1 time: 0.152106 Sep 12 14:18:15.478276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 335/675] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:15 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:15.662554 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:15.663365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:15.669333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.669836 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.670262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.670973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:15.671422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:15.671834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:15.807558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:15.815785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-664057bb-da13-4cc9-9341-9c25d8333cbd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.157577 Sep 12 14:18:15.816539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 341/676] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:15 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:16.501488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:16.502099 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:16.508502 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:16.508981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:16.509414 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:16.510097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:16.510551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:16.511000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:16.637131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:16.644776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed7e65ef-1753-4a3d-8e3a-dea4b8a75c2d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1674 microversion: 2.1 time: 0.147741 Sep 12 14:18:16.645344 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 336/677] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:16 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:16.839124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:16.839733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:16.846517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:16.847083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:16.847504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:16.848175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:16.848617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:16.849031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:16.974785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:16.982427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cfbbe75b-fdfb-40ad-8e28-60ed444ea8eb tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.147236 Sep 12 14:18:16.983030 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 342/678] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:16 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:17.667869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:17.668473 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:17.674807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:17.675310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:17.675738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:17.676437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:17.676883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:17.677316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:17.692315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:17.807937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:17.816228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5bad2d4-8d42-401d-98ed-8f0945cafb54 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1674 microversion: 2.1 time: 0.152202 Sep 12 14:18:17.817023 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 337/679] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:17 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:18.006602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:18.007997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:18.014379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:18.014891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:18.015331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:18.016526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:18.016982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:18.017406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:18.143750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:18.151474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fcb4b7af-4c5a-480f-bbc6-6df719599861 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.149557 Sep 12 14:18:18.152037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 343/680] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:18 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:18.839887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:18.840520 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:18.846992 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:18.847470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:18.847896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:18.848574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:18.849023 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:18.849442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:18.977096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:18.984661 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c87df5a3-c05c-4b2f-aa86-9899b41c00f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1674 microversion: 2.1 time: 0.148700 Sep 12 14:18:18.985722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 338/681] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:18 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:19.175525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:19.176135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:19.182527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:19.183054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:19.183494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:19.184182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:19.184640 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:19.185066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:19.309437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:19.311725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:19.318715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-443879e3-8497-40ce-8ff4-0ddd9e3ee386 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.147752 Sep 12 14:18:19.319318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 344/682] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:19 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:20.008412 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:20.009108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:20.016563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:20.017057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:20.017485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:20.018175 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:20.018622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:20.019061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:20.221573 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:20.229753 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42918c2e-2f5f-4550-94c3-d976ce24a89f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1674 microversion: 2.1 time: 0.225166 Sep 12 14:18:20.230575 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 339/683] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:20 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:20.342634 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:20.343909 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:20.351618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:20.352141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:20.352628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:20.353328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:20.353775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:20.354193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:20.853952 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:20.866667 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-191397d2-eeda-4628-81b3-2a74700e2595 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1685 microversion: 2.1 time: 0.528855 Sep 12 14:18:20.868336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 345/684] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:20 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1685 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:21.336569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb689d73-c89d-4341-9742-b8b4005976dc", "name": "network-vif-deleted", "tag": "eafefb92-feba-40e9-915d-de3bebe30c10"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:21.357710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.365422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.366702 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.407165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] Creating event network-vif-deleted:eafefb92-feba-40e9-915d-de3bebe30c10 for instance eb689d73-c89d-4341-9742-b8b4005976dc on hv-cinder-82002 Sep 12 14:18:21.413694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-af4ee68d-853d-4f92-bb27-2bf0548cc237 req-aae21441-ebda-4e65-b798-73be2bb3b409 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082863 Sep 12 14:18:21.417272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 346/685] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:21.458664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:21.459660 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:21.467824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.468695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.469905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.471310 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.472150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.473376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.592957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:21.605501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd93c6ae-da32-4e3d-8716-f85c78bf8aaf tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1606 microversion: 2.1 time: 0.355204 Sep 12 14:18:21.612557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 340/686] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:21 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1606 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:21.807174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58855138-24d4-43f5-bbf2-c470cb31e738", "name": "network-vif-deleted", "tag": "9b4b2dfa-ae8b-4ebb-b407-6236bc862edd"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:21.820919 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.824252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.825045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.843970 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] Creating event network-vif-deleted:9b4b2dfa-ae8b-4ebb-b407-6236bc862edd for instance 58855138-24d4-43f5-bbf2-c470cb31e738 on hv-cinder-82002 Sep 12 14:18:21.850460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-892146c8-95a0-4f52-822e-73c04e8605db req-877f4a1d-9a79-4d5f-9a7d-22d3c3fab440 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048413 Sep 12 14:18:21.852263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 347/687] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:21.892416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:21.893030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:21.899350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.899837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.900275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.901046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.901432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.902057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.935966 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:21.936454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:21.937176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:21.938365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'fault' on Instance uuid eb689d73-c89d-4341-9742-b8b4005976dc {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:21.978677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:21.987252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99892ef5-32bd-4da0-982b-4b6118974a2d tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 200 len: 1334 microversion: 2.1 time: 0.099046 Sep 12 14:18:21.987875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 341/688] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:21 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:22.631562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:22.633080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:22.639982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:22.640537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:22.641564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:22.642338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:22.643020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:22.643517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:22.677883 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:22.679875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:22.680511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:22.681142 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'fault' on Instance uuid 58855138-24d4-43f5-bbf2-c470cb31e738 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:22.732225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:22.743133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-84f86bf5-fe19-40e5-b6a3-72e33637abb1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 200 len: 1328 microversion: 2.1 time: 0.116168 Sep 12 14:18:22.748744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 348/689] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:22 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:22.913777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:22.914280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:22.920706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:22.921186 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:22.921621 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:22.922905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:22.923366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:22.923805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:22.947269 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38cc6450-807a-4543-b9d3-2ad82e6b79ab tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.037399 Sep 12 14:18:22.947849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 342/690] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:18:22 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:23.012091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:23.012700 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: eb689d73-c89d-4341-9742-b8b4005976dc] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:23.020446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:23.020934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:23.021369 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:23.022690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:23.023266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:23.023740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:23.037962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] HTTP exception thrown: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Request method failure captured: Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc HTTP/1.1 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6HAqeH4uA3THeEGY66TmW5JFBqWWE6VpSBn2DgT2hzfK6cFQaPP-DmHN_WeZH75AWmbdIxbQcEkPjoMLx-9xqcmEh2mxfQhVnpA9e5v8hXSpDeNE-mwuUeutYx92Xui3Up3pd3VwO8qGdy7u_VzHkty0JwerxP-SgskOZlk6dGQsE Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:18:23.039656 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366826b14e0e4a93819c18d8d716a254", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 5f2ff5e497b64e49b7ac25a941a06048 Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. Sep 12 14:18:23.041506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'eb689d73-c89d-4341-9742-b8b4005976dc'} Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:23.042534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. Sep 12 14:18:23.044328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.045799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Returning 404 to user: Instance eb689d73-c89d-4341-9742-b8b4005976dc could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:23.045799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5142afa0-881e-44a3-9011-8440f853d33f tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc" status: 404 len: 111 microversion: 2.1 time: 0.034588 Sep 12 14:18:23.045799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 349/691] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:23 2022] GET /compute/v2.1/servers/eb689d73-c89d-4341-9742-b8b4005976dc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:23.049755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07a26701-052e-4d9c-bc4d-d827dc544441 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '.version_select at 0x7f756095eb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:23.070682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07a26701-052e-4d9c-bc4d-d827dc544441 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143412044" status: 202 len: 0 microversion: 2.1 time: 0.023949 Sep 12 14:18:23.073862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 343/692] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 12 14:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143412044 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:23.765465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:23.766107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:23.773394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:23.773886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:23.774322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:23.775048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:23.775502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:23.775926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:23.792906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 HTTP/1.1 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:18:23.794556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:18:23.796230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '58855138-24d4-43f5-bbf2-c470cb31e738'} Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:23.797706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:18:23.799251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:23.800562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:23.800562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-60bc7c76-84c2-4302-bea8-4d1c3bd09dbd tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 404 len: 111 microversion: 2.1 time: 0.034783 Sep 12 14:18:23.800562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 350/693] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:23 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:23.808204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2b5b4df-ecae-4eaf-a31f-6f92e192521d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '.version_select at 0x7f7560931d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:23.834510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2b5b4df-ecae-4eaf-a31f-6f92e192521d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101970077" status: 202 len: 0 microversion: 2.1 time: 0.031956 Sep 12 14:18:23.835132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 344/694] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 12 14:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101970077 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:18:24.374296 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "407634c6-c21f-4614-a200-12dbec7f4523"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:24.376710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:24.382752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:24.383272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:24.383706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:24.384422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:24.384876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:24.385633 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:24.415270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c29fc9c3-9d49-4aaa-b234-cea822b6918d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: .version_select at 0x7f75608eb430>, body: {"keypair": {"name": "tempest-keypair-1872400125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFyZkcR+CZ62IOfy/QtKctq/54sF5OQ5xUUDtQmK2Xlai9vklYk3XinIQFvbUnLqFWxuVpdwBasnQILF39ncjywSwP845R02FucQAej5XyZmhjR5tl6mMD7BTztKEqE8A=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:24.433455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c29fc9c3-9d49-4aaa-b234-cea822b6918d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for project 613c135e354b4262865198bd5c834cb1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:24.437501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c29fc9c3-9d49-4aaa-b234-cea822b6918d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for user e7cb679ed52e42ca83a2084f1ad4bd92 and project 613c135e354b4262865198bd5c834cb1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:24.461087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c29fc9c3-9d49-4aaa-b234-cea822b6918d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050313 Sep 12 14:18:24.461676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 345/695] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:18:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:24.651907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-be625539-7c71-49a4-a7af-0e87ba258306 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281352 Sep 12 14:18:24.652664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 351/696] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:18:24 2022] POST /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:25.706448 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-741921635", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187dae32-ddb7-498c-baaa-a0f8b012a4b7"}], "security_groups": [{"name": "tempest-securitygroup--1834390979"}], "key_name": "tempest-keypair-1872400125", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:25.815794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] validate_networks() for [('187dae32-ddb7-498c-baaa-a0f8b012a4b7', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:18:26.025172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:26.025826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:26.031998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.032543 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.033059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.033729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.034172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.034586 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.058757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:26.134429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-31810320-0a05-4c90-bb2c-2ecbb1994ae9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 204 len: 0 microversion: 2.1 time: 0.113650 Sep 12 14:18:26.135311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 352/697] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:26 2022] DELETE /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:18:26.145585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:26.146649 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:26.152873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.153348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.153775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.154480 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.154943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.155364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.186571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:18:26.187309 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:18:26.188584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:18:26.189152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:18:26.189583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:18:26.198172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.198653 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.199289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.200005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:26.200455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:26.200873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:26.218500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for project 613c135e354b4262865198bd5c834cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:26.223137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Getting quotas for user e7cb679ed52e42ca83a2084f1ad4bd92 and project 613c135e354b4262865198bd5c834cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:26.235039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:18:26.237441 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:18:26.286374 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1cbff45e-cbd1-4077-a83c-6342b5f7488a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584699 Sep 12 14:18:26.287239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 346/698] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:18:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:18:26.291806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:26.298382 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a0854db-24ed-4a85-adfa-381e5a3de8b5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:26.299032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a0854db-24ed-4a85-adfa-381e5a3de8b5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:26.300731 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f28b82d9-eeb6-429b-8252-4f547623f5db tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1506 microversion: 2.1 time: 0.160266 Sep 12 14:18:26.301306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 353/699] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:26 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:26.357003 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a0854db-24ed-4a85-adfa-381e5a3de8b5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:26.365165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a0854db-24ed-4a85-adfa-381e5a3de8b5 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1237 microversion: 2.1 time: 0.071017 Sep 12 14:18:26.365728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 347/700] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:26 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:27.324449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:27.325080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:27.332143 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:27.332614 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:27.333041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:27.333720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:27.334169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:27.334598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:27.388226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:27.388934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:27.396243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:27.396734 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:27.397167 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:27.397875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:27.398321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:27.398744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:27.466522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:27.474221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-abbe8802-2b1a-4565-856a-a489299689a7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1241 microversion: 2.1 time: 0.089874 Sep 12 14:18:27.474804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 348/701] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:27 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:27.487847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:27.495672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-06af4086-d132-4694-b7ca-36e2baf4cdd6 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1506 microversion: 2.1 time: 0.175100 Sep 12 14:18:27.496231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 354/702] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:27 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:28.497060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:28.497669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:28.504104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:28.504583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:28.505010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:28.505695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:28.506138 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:28.506552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:28.593524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:28.603157 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bfdf46a9-17b6-4d53-9136-deea9ee607ed tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1233 microversion: 2.1 time: 0.110054 Sep 12 14:18:28.610206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 349/703] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:28 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:28.662168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:28.662979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:28.669360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:28.669840 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:28.670270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:28.671014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:28.671466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:28.672052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:28.805342 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:28.813241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-53036e01-21fa-4c8d-9d85-1a4e35ff7dcd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1506 microversion: 2.1 time: 0.298222 Sep 12 14:18:28.813859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 355/704] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:28 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:29.161356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb87e92-51b9-4304-9f0b-2e4297d74891", "name": "network-vif-deleted", "tag": "a82000b1-9b15-4c48-b984-b96ae2bf4e5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:29.172905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.173721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.174387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.192072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] Creating event network-vif-deleted:a82000b1-9b15-4c48-b984-b96ae2bf4e5f for instance cdb87e92-51b9-4304-9f0b-2e4297d74891 on hv-cinder-82002 Sep 12 14:18:29.200822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b04e3d76-0e5c-483d-b206-209c1b7bea4f req-77ae5e14-4215-44c5-9091-af622cdec1c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042785 Sep 12 14:18:29.201696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 350/705] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:29.629597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:29.630628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:29.636899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.637439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.637871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.638696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.639174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.639592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.703602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:29.711211 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1decbed2-6cd3-4df5-9085-0735998abc27 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1295 microversion: 2.1 time: 0.086094 Sep 12 14:18:29.711778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 356/706] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:29 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:29.838040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:29.839388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:29.846816 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.847624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.848611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.849963 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.850443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.850900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.886682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:29.887218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:29.887764 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:29.888396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'fault' on Instance uuid cdb87e92-51b9-4304-9f0b-2e4297d74891 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:29.937239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:29.946800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de5e8f13-9e06-436d-94c0-ead617c5956a tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 200 len: 1312 microversion: 2.1 time: 0.113438 Sep 12 14:18:29.963034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 351/707] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:29 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 1312 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:30.735494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:30.736109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:30.742570 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:30.743088 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:30.743522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:30.744217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:30.744666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:30.745089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:30.873493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:30.881777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bfd898d9-a448-44c2-824e-4bd5a95270f7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.150742 Sep 12 14:18:30.882344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 357/708] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:30 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:30.970427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:30.971111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: cdb87e92-51b9-4304-9f0b-2e4297d74891] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:30.977587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:30.978057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:30.978484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:30.979326 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:30.979657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:30.980193 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:30.997750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] HTTP exception thrown: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Request method failure captured: Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 HTTP/1.1 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6HAqeH4uA3THeEGY66TmW5JFBqWWE6VpSBn2DgT2hzfK6cFQaPP-DmHN_WeZH75AWmbdIxbQcEkPjoMLx-9xqcmEh2mxfQhVnpA9e5v8hXSpDeNE-mwuUeutYx92Xui3Up3pd3VwO8qGdy7u_VzHkty0JwerxP-SgskOZlk6dGQsE Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:30.999658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366826b14e0e4a93819c18d8d716a254", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 5f2ff5e497b64e49b7ac25a941a06048 Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. Sep 12 14:18:31.001282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'cdb87e92-51b9-4304-9f0b-2e4297d74891'} Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:31.002825 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. Sep 12 14:18:31.004227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.006810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Returning 404 to user: Instance cdb87e92-51b9-4304-9f0b-2e4297d74891 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:31.008035 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf4f97d1-2d1e-4a1b-8a75-b7e3a28db3c2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891" status: 404 len: 111 microversion: 2.1 time: 0.041512 Sep 12 14:18:31.011973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:30 2022] GET /compute/v2.1/servers/cdb87e92-51b9-4304-9f0b-2e4297d74891 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:31.018216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:31.018711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.024899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.025663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.026102 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.026805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.027284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.027707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.065189 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:31.144531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4d7c70a3-932a-4d21-8d88-95b229c29f86 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "DELETE /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 204 len: 0 microversion: 2.1 time: 0.130582 Sep 12 14:18:31.145085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 358/710] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:31 2022] DELETE /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:18:31.153735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:31.154673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.161572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.162151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.162583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.163295 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.163741 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.164156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.219048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a394905a-e979-41eb-9861-ea58c9a875d5", "tag": "9a806fa5-8e1e-44d6-ad92-6327e1178def"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:31.229845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.230594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.231257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.235399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:31.245252 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] Creating event network-changed:9a806fa5-8e1e-44d6-ad92-6327e1178def for instance a394905a-e979-41eb-9861-ea58c9a875d5 on hv-cinder-82002 Sep 12 14:18:31.251126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d6812236-5058-47b5-8852-4fecfe231539 req-d7b5f57a-abd3-4551-9bd0-630899ce005d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036577 Sep 12 14:18:31.252255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 359/711] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:31.296167 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:31.305095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6df8fe52-2f54-43dd-8611-712a045ce03c tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.155214 Sep 12 14:18:31.305731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 353/712] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:31 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:31.365535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "407634c6-c21f-4614-a200-12dbec7f4523"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:31.367915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.375198 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.375677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.376109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.376825 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.377274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.377688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.454993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: POST /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments HTTP/1.1 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 74 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:18:31.456696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {"volumeAttachment": {"volumeId": "407634c6-c21f-4614-a200-12dbec7f4523"}} Sep 12 14:18:31.458334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'server_id': 'd4e8856b-07c8-4b63-8ab0-f22e2be080a6', 'body': {'volumeAttachment': {'volumeId': '407634c6-c21f-4614-a200-12dbec7f4523'}}} Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.459293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:31.460679 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 400 to user: Invalid volume: volume 407634c6-c21f-4614-a200-12dbec7f4523 is already attached to instances: d4e8856b-07c8-4b63-8ab0-f22e2be080a6 {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d528e3aa-4de6-4ca3-8e06-a346fdcde4f6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098443 Sep 12 14:18:31.462168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 360/713] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:18:31 2022] POST /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:18:31.524461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:31.524961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.530761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.531279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.531715 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.532409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.533460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.533883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.612553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'services' on Instance uuid d4e8856b-07c8-4b63-8ab0-f22e2be080a6 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:31.685508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea993fd7-84eb-4021-b410-76029203e09c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments/407634c6-c21f-4614-a200-12dbec7f4523" status: 202 len: 0 microversion: 2.1 time: 0.164651 Sep 12 14:18:31.686086 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 354/714] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:18:31 2022] DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments/407634c6-c21f-4614-a200-12dbec7f4523 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:31.694729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:31.696913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.702779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.703289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.703722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.704913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.705375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.705791 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.735393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f7ee624c-4687-46bf-8509-0f584e44e04f tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Sep 12 14:18:31.735962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 361/715] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:31 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:31.904842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:31.905476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:31.911688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.912169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.912604 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:31.913290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:31.913742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:31.914165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:32.041685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:32.049316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f958ec2-4885-4377-9855-1eac583f5592 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.148708 Sep 12 14:18:32.049882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 355/716] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:31 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:32.329159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:32.329807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:32.336640 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:32.337119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:32.337555 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:32.338269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:32.338737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:32.339186 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:32.474303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:32.481894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-36d0c142-816c-4c91-a488-c0a4e626fc04 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.156729 Sep 12 14:18:32.482450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 362/717] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:32 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:32.748574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:32.750849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:32.756847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:32.757330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:32.757764 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:32.758440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:32.758911 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:32.759331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:32.790425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e497b714-ebb5-4c74-8aaa-4fe817d7bc3b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Sep 12 14:18:32.791013 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 356/718] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:32 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:33.072699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:33.073313 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:33.080139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.080601 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.081035 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.081729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.082178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.082600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.213164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:33.221330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-931b8c3b-f21a-4caf-955a-4491187a6464 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.152570 Sep 12 14:18:33.221894 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 363/719] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:33 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:33.507514 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:33.508025 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:33.510423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:33.515676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.516151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.516578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.517928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.518381 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.518799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.645748 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:33.653319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5976425-d565-4e23-9886-779cb76249aa tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.149750 Sep 12 14:18:33.653883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 357/720] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:33 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:33.802911 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:33.805197 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:33.812014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.812493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.812920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.813599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:33.814045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:33.814461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:33.846483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ac4b1c47-91a0-4eb0-8741-c4f44489b319 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Sep 12 14:18:33.847064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 364/721] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:33 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:34.243809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:34.244349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:34.250298 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.250778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.251745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.252437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.252890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.253313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.378985 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:34.388027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a2147c2-3556-40b7-a0da-e81ec5689ab8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.148145 Sep 12 14:18:34.388609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 358/722] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:34 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:34.676415 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:34.677002 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:34.682954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.683431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.683859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.684536 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.684984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.685401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.812416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:34.820853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-22c1afba-0bc5-4d7d-b5a4-2dd04a0e8be7 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.148815 Sep 12 14:18:34.821421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 365/723] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:34 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:34.858897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:34.861667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:34.868037 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.868510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.868938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.869615 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:34.870061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:34.870478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:34.873954 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:34.901026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50f10ba3-1a1c-46d3-adc4-a9bde3438bd0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Sep 12 14:18:34.901575 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 359/724] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:34 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:35.413445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:35.413445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:35.419472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.419952 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.420379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.421063 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.421513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.421933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.551674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:35.559258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-59534c99-4a3f-4046-8680-9583d7165eeb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.150323 Sep 12 14:18:35.559819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:35 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:35.844430 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:35.846112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:35.852536 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.853158 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.853677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.854549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.855088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.855572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.913574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:35.915739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:35.921935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.922416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.922875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.924256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:35.924704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:35.925123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:35.960545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cdae4ef4-924c-4c15-8874-16ce216f38e4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050854 Sep 12 14:18:35.965490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 367/726] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:35 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:35.999768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:36.010402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6b7ef07-ceef-4f31-92f3-f0000d4edcd9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1520 microversion: 2.1 time: 0.170195 Sep 12 14:18:36.031843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 360/727] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:35 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:36.582373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:36.583036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:36.585018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:36.590934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:36.591582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:36.592017 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:36.592706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:36.593154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:36.593672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:36.770766 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:36.784338 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-97d168a8-334e-4abc-b284-906d2afd8f03 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.206242 Sep 12 14:18:36.787424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 368/728] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:36 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:36.789146 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d23509-c830-4101-bcd2-9f320baffe8e", "name": "network-vif-deleted", "tag": "42101474-6616-44ed-98de-9145d66931c3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:36.795722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:36.796498 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:36.800687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:36.801244 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:36.801754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:36.814065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] Creating event network-vif-deleted:42101474-6616-44ed-98de-9145d66931c3 for instance 88d23509-c830-4101-bcd2-9f320baffe8e on hv-cinder-82002 Sep 12 14:18:36.824179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c5eed926-9fee-4d99-9f54-089d68ad9138 req-935c453a-fe27-4e90-bee5-a4f39972c215 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039814 Sep 12 14:18:36.824788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 361/729] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:36.973767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:36.975948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:36.982331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:36.982749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:36.983213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:36.983897 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:36.984353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:36.984774 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.013377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-eaf65119-a99b-4f4c-97fe-7780bc8c9c92 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044092 Sep 12 14:18:37.013936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 369/730] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:36 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:18:37.051370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:37.052076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:37.059420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.060147 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.060791 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.061996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.062681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.063329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.090568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:37.091343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:37.101233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.101755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.102138 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.102780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'fault' on Instance uuid 88d23509-c830-4101-bcd2-9f320baffe8e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:37.104299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.104986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.105675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.106750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.107438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.107972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.139053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:37.154628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:37.166341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa80efa5-e51b-4a25-a6a1-755cfbfd19a9 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1312 microversion: 2.1 time: 0.120201 Sep 12 14:18:37.167272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 362/731] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:37 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:37.225978 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b46219d9-2a33-4f7c-8491-4d45b82741ad tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 204 len: 0 microversion: 2.1 time: 0.139192 Sep 12 14:18:37.226564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 370/732] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:37 2022] DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:18:37.234769 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:37.235510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:37.241941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.242422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.242884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.243583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.244039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.244463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.383972 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:37.392277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21034d8e-51c3-46ea-97b0-97a590576620 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1680 microversion: 2.1 time: 0.161477 Sep 12 14:18:37.393279 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 363/733] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:37 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:37.810675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:37.811391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:37.818093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.818567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.819042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.819719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:37.820164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:37.820580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:37.945197 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:37.952955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3f75df9c-7b54-4289-ba6b-b8379057435b tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.146173 Sep 12 14:18:37.953516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 371/734] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:37 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:38.195202 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:38.195812 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:38.202237 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.202717 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.203184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.203872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.204353 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.204778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.234466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.234932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.235906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.236351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lazy-loading 'fault' on Instance uuid 88d23509-c830-4101-bcd2-9f320baffe8e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:38.275532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2ff5e497b64e49b7ac25a941a06048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366826b14e0e4a93819c18d8d716a254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:38.283074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5af97111-9adc-486c-9b56-eae1dee94dfd tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 200 len: 1312 microversion: 2.1 time: 0.092823 Sep 12 14:18:38.283647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 364/735] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:38 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:38.416458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:38.416994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:38.423873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.424350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.424798 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.425458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.425904 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.426324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.557442 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:38.565986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c1ebc7d7-4161-4e92-a7c8-fed9704693ca tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1680 microversion: 2.1 time: 0.153556 Sep 12 14:18:38.566548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 372/736] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:38 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:38.977032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:38.977636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:38.983716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.984191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.984620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:38.985301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:38.985747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:38.986190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.112737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:39.120554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8496a0ac-43d6-47ea-a760-f351eaa31227 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.147640 Sep 12 14:18:39.121122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 365/737] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:38 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:39.305941 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:39.306640 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] [instance: 88d23509-c830-4101-bcd2-9f320baffe8e] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:39.316484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a394905a-e979-41eb-9861-ea58c9a875d5", "name": "network-vif-plugged", "status": "completed", "tag": "9a806fa5-8e1e-44d6-ad92-6327e1178def"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:39.318957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:39.319457 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:39.320141 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.320858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:39.321316 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:39.321780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.329794 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:39.330495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:39.331443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.343722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] HTTP exception thrown: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. Sep 12 14:18:39.345190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] Creating event network-vif-plugged:9a806fa5-8e1e-44d6-ad92-6327e1178def for instance a394905a-e979-41eb-9861-ea58c9a875d5 on hv-cinder-82002 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Request method failure captured: Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e HTTP/1.1 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6HAqeH4uA3THeEGY66TmW5JFBqWWE6VpSBn2DgT2hzfK6cFQaPP-DmHN_WeZH75AWmbdIxbQcEkPjoMLx-9xqcmEh2mxfQhVnpA9e5v8hXSpDeNE-mwuUeutYx92Xui3Up3pd3VwO8qGdy7u_VzHkty0JwerxP-SgskOZlk6dGQsE Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:18:39.346109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/366826b14e0e4a93819c18d8d716a254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_366826b14e0e4a93819c18d8d716a254", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 366826b14e0e4a93819c18d8d716a254 Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-49662104 Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 5f2ff5e497b64e49b7ac25a941a06048 Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-49662104-project Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. Sep 12 14:18:39.347440 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '88d23509-c830-4101-bcd2-9f320baffe8e'} Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:39.348227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. Sep 12 14:18:39.349408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:39.350454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-611cd255-acc2-4616-b71e-17d1b832de47 req-67e15016-a353-4c26-96bd-afdd26fad5f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039443 Sep 12 14:18:39.351391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 366/738] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:39.353169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] Returning 404 to user: Instance 88d23509-c830-4101-bcd2-9f320baffe8e could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:39.354253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c2c85d64-0aef-4daa-9ae7-11e6d63f45b2 tempest-ServerRescueNegativeTestJSON-49662104 tempest-ServerRescueNegativeTestJSON-49662104-project] 10.222.0.42 "GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e" status: 404 len: 111 microversion: 2.1 time: 0.052653 Sep 12 14:18:39.355349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 373/739] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:39 2022] GET /compute/v2.1/servers/88d23509-c830-4101-bcd2-9f320baffe8e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:39.590682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:39.591550 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:39.598064 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:39.598695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:39.599191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.599980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:39.600505 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:39.600999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:39.839151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:39.847268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c89de01a-794c-45e8-b2be-2b6c244326a0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1680 microversion: 2.1 time: 0.260741 Sep 12 14:18:39.848032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 367/740] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:39 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:40.024349 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e8856b-07c8-4b63-8ab0-f22e2be080a6", "name": "network-vif-deleted", "tag": "0e35527d-008f-43d4-89a7-ebd020d16331"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:40.049636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.051358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.052036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.071133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] Creating event network-vif-deleted:0e35527d-008f-43d4-89a7-ebd020d16331 for instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 on hv-cinder-82002 Sep 12 14:18:40.076950 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-93b2f8fd-c767-4b1c-a64d-efe47a5a677a req-c901e345-1680-4558-b23b-a2c5d5cbc94f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055872 Sep 12 14:18:40.078156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 374/741] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:40.144299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:40.145218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:40.152426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.152927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.153366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.154341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.155844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.156341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.643837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:40.652465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ffc3744-84c1-4df6-a42d-256ec478cfd8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1363 microversion: 2.1 time: 0.513087 Sep 12 14:18:40.654197 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 368/742] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:40 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:40.871707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:40.872403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:40.879070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.879558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.879991 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.880678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.881236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.881643 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.915025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:40.915998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:40.916475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:40.917092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'fault' on Instance uuid d4e8856b-07c8-4b63-8ab0-f22e2be080a6 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:41.026057 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:41.030597 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:41.036419 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5e8179eb-935e-42aa-b8b1-562631fe5713 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 200 len: 1329 microversion: 2.1 time: 0.168873 Sep 12 14:18:41.049599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 375/743] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:40 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 1329 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:41.677965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:41.678731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:41.685236 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:41.685714 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:41.686148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:41.687127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:41.687808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:41.688380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:41.835485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:41.843893 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b8dba73-e545-4ae0-ae73-08518d6b9be8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1548 microversion: 2.1 time: 0.171006 Sep 12 14:18:41.844557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 369/744] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:41 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:41.867594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:41.868206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:41.876489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:41.877115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:41.877560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:41.878258 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:41.878914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:41.879374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:41.964203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-df950705-48f3-43ed-a908-be45c4507901 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100670 Sep 12 14:18:41.965159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 376/745] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:18:41 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:42.060441 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:42.061494 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:42.068429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:42.069516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:42.069648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:42.070302 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:42.074731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:42.074731 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:42.087252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 HTTP/1.1 Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:42.088947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:18:42.090239 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd4e8856b-07c8-4b63-8ab0-f22e2be080a6'} Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:42.091211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:18:42.092662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:42.093746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:42.093746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8428a3e2-d6d4-4010-b2fd-9e05ec17a406 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 404 len: 111 microversion: 2.1 time: 0.035358 Sep 12 14:18:42.101653 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a44a77cc-918b-43bc-9334-81d1db79d9bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '.version_select at 0x7f75608ab940>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:42.103012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 370/746] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:42 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:42.122347 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a44a77cc-918b-43bc-9334-81d1db79d9bc tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86572089" status: 202 len: 0 microversion: 2.1 time: 0.024841 Sep 12 14:18:42.123437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 377/747] 10.222.0.42 () {58 vars in 1215 bytes} [Mon Sep 12 14:18:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86572089 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:43.582012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ffff25b-8046-49cd-83a8-19a4a0627625 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: .version_select at 0x7f756099d820>, body: {"keypair": {"name": "tempest-keypair-501083337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFlcU2oQ6dNxNAr8bZ57Sb4o/wtqwWrae4ZjC/DyL9A6bPhPszIvMYc2v2Kk13zZIa98mw7WIkH5wvLEMYZqNLaUBQVKgvFz/F44QYtauxatodXv+mbuwSEeNgnPzC83g=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:43.599220 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ffff25b-8046-49cd-83a8-19a4a0627625 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:43.603139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ffff25b-8046-49cd-83a8-19a4a0627625 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:43.628225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ffff25b-8046-49cd-83a8-19a4a0627625 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050200 Sep 12 14:18:43.635181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 371/748] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:18:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:43.723927 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a394905a-e979-41eb-9861-ea58c9a875d5", "tag": "9a806fa5-8e1e-44d6-ad92-6327e1178def"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:43.734949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:43.736046 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:43.736799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:43.748557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] Creating event network-changed:9a806fa5-8e1e-44d6-ad92-6327e1178def for instance a394905a-e979-41eb-9861-ea58c9a875d5 on hv-cinder-82002 Sep 12 14:18:43.754613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-bc248400-b354-4b4e-aa3f-376dab2b3935 req-354064d7-cd47-4722-9618-24b607a7b39f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Sep 12 14:18:43.758398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 378/749] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:44.703517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31de18fa-d5e5-4548-bedf-7135037c98e3 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Action: 'create', calling method: .version_select at 0x7f7560969af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-243589296"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:45.065512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31de18fa-d5e5-4548-bedf-7135037c98e3 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.536016 Sep 12 14:18:45.073957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 372/750] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Sep 12 14:18:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 537 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 14:18:45.080626 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-03dcdfef-4e1b-4ccb-929c-ba4f953eddb9 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75607ec8b0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:45.140826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-03dcdfef-4e1b-4ccb-929c-ba4f953eddb9 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 200 len: 344 microversion: 2.1 time: 0.065257 Sep 12 14:18:45.142871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 379/751] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:18:45 2022] GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:45.289134 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-763861319", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9236f9c0-b543-4fbe-9872-2a3e0012862d"}], "security_groups": [{"name": "tempest-securitygroup--2130946362"}], "key_name": "tempest-keypair-501083337", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:45.392592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] validate_networks() for [('9236f9c0-b543-4fbe-9872-2a3e0012862d', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:18:45.533797 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1278969989"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:45.534467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:45.541066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:45.541547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:45.541972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:45.542657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:45.543132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:45.543839 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:45.677036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.network.security_group_api [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Removing security group 2a824313-c1b2-4e4f-ad64-9746fb4e0360 from port c158483b-3937-4578-983a-bbaad6989bb8 Sep 12 14:18:46.011162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:18:46.011655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:18:46.012050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:18:46.012459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:18:46.012867 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:18:46.021585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:46.022061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:46.022490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:46.023242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:46.023695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:46.024116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:46.040689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:18:46.044917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Getting quotas for user fff8e93029f447bb8294d9b516eb407f and project 4a72919a47034a2684973f31e4217f3e. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:18:46.057172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:18:46.059568 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:18:46.107171 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2970a041-be9b-4fe0-b299-c8b0c009f170 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.822245 Sep 12 14:18:46.108064 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 373/752] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:18:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:18:46.119992 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db647231-04a5-4c68-badc-43c7b99a63a7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:46.120770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db647231-04a5-4c68-badc-43c7b99a63a7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:46.134627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fd28ef8a-1d8c-4a2f-97d8-017d4df2a41f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action" status: 202 len: 0 microversion: 2.1 time: 0.604686 Sep 12 14:18:46.136545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 380/753] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:18:45 2022] POST /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:18:46.146109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:46.158743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:46.159624 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:46.160467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:46.176539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] Creating event network-changed:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:18:46.182593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-3b22f2c9-c9b3-4d90-9e00-59243b795129 req-81f3a08f-3f52-418a-9d47-7c81d4170811 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040187 Sep 12 14:18:46.183985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 381/754] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:46.190384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a39c95a2-2c2e-4e0a-8c35-fcc563aace16 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f756081bee0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:46.264123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db647231-04a5-4c68-badc-43c7b99a63a7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:46.272664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db647231-04a5-4c68-badc-43c7b99a63a7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1240 microversion: 2.1 time: 0.156544 Sep 12 14:18:46.275606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 374/755] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:46 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1240 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:46.317559 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a39c95a2-2c2e-4e0a-8c35-fcc563aace16 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 200 len: 345 microversion: 2.1 time: 0.132145 Sep 12 14:18:46.323550 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 382/756] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:18:46 2022] GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:46.331149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ba0de14-4ff5-463e-b0b4-ee06865e8c43 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Action: 'create', calling method: .version_select at 0x7f75608eb550>, body: {"snapshot": {"volume_id": "6c3bf278-3492-4b3c-9a89-1048009a031f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1257123489"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:46.547432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ba0de14-4ff5-463e-b0b4-ee06865e8c43 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.220242 Sep 12 14:18:46.555023 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 375/757] 10.222.0.42 () {60 vars in 1162 bytes} [Mon Sep 12 14:18:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:46.559801 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4d663d82-ad46-4edf-b81d-66c190a35745 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75608abc10>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:46.592378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4d663d82-ad46-4edf-b81d-66c190a35745 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 287 microversion: 2.1 time: 0.036383 Sep 12 14:18:46.593023 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 383/758] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:46 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:46.604847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6b1f9682-750f-40bf-aed1-9c420591dd7e tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f7560956af0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:46.650610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6b1f9682-750f-40bf-aed1-9c420591dd7e tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.049869 Sep 12 14:18:46.651282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 376/759] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Sep 12 14:18:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:46.663642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a1183c1e-b01f-4dea-9359-d26cdb59a1a3 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75608bdee0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:46.705589 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a1183c1e-b01f-4dea-9359-d26cdb59a1a3 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 287 microversion: 2.1 time: 0.045917 Sep 12 14:18:46.706991 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 384/760] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:46 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:47.298803 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:47.299563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:47.305464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.305944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.306370 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.307085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.307532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.307952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.401986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:47.409489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd580742-703d-4929-b3ff-33845ff24919 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1244 microversion: 2.1 time: 0.115388 Sep 12 14:18:47.410058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 377/761] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:47 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:47.493605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:47.494224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:47.501620 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.502114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.502553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.503273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.503725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.504148 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.587871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lazy-loading 'services' on Instance uuid b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:47.661129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5402b2a0-e274-4552-92ff-3adfe569cd73 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments/5aa43f01-80d5-4525-aa26-636b5975602e" status: 202 len: 0 microversion: 2.1 time: 0.171774 Sep 12 14:18:47.661668 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 385/762] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:18:47 2022] DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments/5aa43f01-80d5-4525-aa26-636b5975602e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:47.670114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:47.672391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:47.679355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.679837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.680268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.680948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:47.681427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:47.681853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:47.710497 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51a952c8-b93e-4177-bcfb-bda21993d05c tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Sep 12 14:18:47.711088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 378/763] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:47 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:47.719965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ac41aede-e9cb-4cbc-8c38-d3d5014eb3d0 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75607ecdc0>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:47.750306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ac41aede-e9cb-4cbc-8c38-d3d5014eb3d0 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 287 microversion: 2.1 time: 0.034830 Sep 12 14:18:47.750935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 386/764] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:47 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:48.203233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:48.213634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:48.214098 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:48.214515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:48.226180 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] Creating event network-changed:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:18:48.231721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-63b08c15-7a22-48c4-b3fe-7239748f9db5 req-c6b05460-74c2-44fb-a59b-f6b104a0d85b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 Sep 12 14:18:48.232318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 379/765] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:48.432556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:48.433225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:48.440253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:48.440731 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:48.441165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:48.441849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:48.442301 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:48.442718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:48.506551 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:48.515304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9eade2b6-d3e2-4320-82c4-498e83dcc4b9 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1244 microversion: 2.1 time: 0.086667 Sep 12 14:18:48.515878 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 387/766] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:48 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:48.726369 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:48.728898 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:48.737304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:48.737780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:48.738208 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:48.738917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:48.739363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:48.739777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:48.763060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d170f7b5-7d43-44c9-91d1-6b96fdd2184c tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75608bd790>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:48.769650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6585a99b-aec2-4695-a6bf-009156d17637 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049361 Sep 12 14:18:48.770206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 380/767] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:48 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:48.792719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d170f7b5-7d43-44c9-91d1-6b96fdd2184c tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 287 microversion: 2.1 time: 0.033478 Sep 12 14:18:48.793304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 388/768] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:48 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:49.537949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:49.538799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:49.552033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:49.552548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:49.552976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:49.553666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:49.554303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:49.554724 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:49.620360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:49.629150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cbd0dc21-b190-4bdc-af4c-1460ca5dbae8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1236 microversion: 2.1 time: 0.095324 Sep 12 14:18:49.629851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 381/769] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:49 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:49.782442 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:49.784688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:49.792699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:49.793178 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:49.793603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:49.794279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:49.794726 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:49.795168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:49.805062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2e6303f-290f-499f-9bee-b0c829cde7da tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f756099d430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:49.827403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-20b121e8-3ddf-484f-91ca-e3473ec3cc24 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049224 Sep 12 14:18:49.832118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 389/770] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:49 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:49.845251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e2e6303f-290f-499f-9bee-b0c829cde7da tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 288 microversion: 2.1 time: 0.043347 Sep 12 14:18:49.846117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 382/771] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:49 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:49.857092 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-438cfd35-b8d5-4d49-a76a-d5b2d099fd08 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f7560770040>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:49.921295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-438cfd35-b8d5-4d49-a76a-d5b2d099fd08 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 202 len: 0 microversion: 2.1 time: 0.067852 Sep 12 14:18:49.922018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 390/772] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Sep 12 14:18:49 2022] DELETE /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:49.930807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a370801-790d-473b-880e-60e608cd7fda tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75608eba60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:49.964128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a370801-790d-473b-880e-60e608cd7fda tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 200 len: 287 microversion: 2.1 time: 0.037078 Sep 12 14:18:49.964698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 383/773] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:49 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:50.652425 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:50.652957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:50.658920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.659408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.659843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.660531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.660988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.661429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.726156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:50.733896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-54974130-66d4-4c03-b006-9dd0940bc168 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1298 microversion: 2.1 time: 0.085367 Sep 12 14:18:50.734470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 391/774] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:50 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:50.840009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:50.842933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:50.851474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.851953 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.852385 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.853069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.853515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.853927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.883698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2afb6297-85d9-4bda-9e50-adc6add40d51 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047648 Sep 12 14:18:50.884256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 384/775] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:18:50 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:18:50.895373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:50.895877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:50.902346 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.902899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.903292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.903975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:50.904420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:50.904837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:50.976689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d767c96-9693-4de4-ad85-3a31729fb9ad tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75608ebf70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:50.978907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] HTTP exception thrown: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 is not attached to volume 5aa43f01-80d5-4525-aa26-636b5975602e Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Request method failure captured: Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments/5aa43f01-80d5-4525-aa26-636b5975602e HTTP/1.1 Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz8hK83fCkQE4y0j5sZtKRL40LdhuaxFQuhTil6QZHXDo4FFStJqqkhcUB3vQiWzFm9G9TzCpdNJA_lM29ES6LaEIVaZD1KupHNUl44brNZSj_hygOiNLnLwf-WlsJnBoLmc3nL6WeAJegIiTJ8YNLreKJt1OyXCoU1sTswaFW7aBxU Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 40918a5eb3134a00999618cb65dedbbd Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:18:50.981526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40918a5eb3134a00999618cb65dedbbd", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 40918a5eb3134a00999618cb65dedbbd Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-TestMinimumBasicScenario-802824971-project Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 67c00c7b37ba44aa9ca0e4555d32ec90 Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestMinimumBasicScenario-802824971-project Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:18:50.983025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 is not attached to volume 5aa43f01-80d5-4525-aa26-636b5975602e Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'server_id': 'b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1', 'id': '5aa43f01-80d5-4525-aa26-636b5975602e'} Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5aa43f01-80d5-4525-aa26-636b5975602e. Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:50.983876 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 is not attached to volume 5aa43f01-80d5-4525-aa26-636b5975602e Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 is not attached to volume 5aa43f01-80d5-4525-aa26-636b5975602e Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:18:50.985709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Returning 404 to user: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 is not attached to volume 5aa43f01-80d5-4525-aa26-636b5975602e {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:50.987299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2eedee84-de68-48d3-9b30-0dbfa5b77159 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments/5aa43f01-80d5-4525-aa26-636b5975602e" status: 404 len: 154 microversion: 2.1 time: 0.092213 Sep 12 14:18:50.987299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 392/776] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:18:50 2022] DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1/os-volume_attachments/5aa43f01-80d5-4525-aa26-636b5975602e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:51.007067 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6d767c96-9693-4de4-ad85-3a31729fb9ad tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] HTTP exception thrown: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d767c96-9693-4de4-ad85-3a31729fb9ad tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Request method failure captured: Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 HTTP/1.1 Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz_E6-07swno548OBCapfo35_pK5MXYG_A-QFyyOMZun_B3GBn4cGD-kGdqnCNSUpByIU7lyciIn5_v7UVVJNtio-IpVEKI9JNc-ZXiQfCCs4Mr8xkqCWs_ppo3iKNqZqn_MPFavuuIGu8YSIDv1KYx59p_eKmCfVj4ilKC-9mbxYnM Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:51.009596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983920985ad438a8725654371ffbe4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983920985ad438a8725654371ffbe4f", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e6555c0ef9444e40a87b6f2351b408c1 Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '7db09cd5-0b3a-4af2-a948-6674215f3815'} Sep 12 14:18:51.011038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. (HTTP 404) (Request-ID: req-29a3750f-e9c7-4b69-a762-51528afb0ed2) Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.012071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:51.013375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 12 14:18:51.014750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d767c96-9693-4de4-ad85-3a31729fb9ad tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Returning 404 to user: Snapshot 7db09cd5-0b3a-4af2-a948-6674215f3815 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:51.016508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d767c96-9693-4de4-ad85-3a31729fb9ad tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815" status: 404 len: 111 microversion: 2.1 time: 0.038088 Sep 12 14:18:51.017466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 385/777] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:18:50 2022] GET /compute/v2.1/os-snapshots/7db09cd5-0b3a-4af2-a948-6674215f3815 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:18:51.022658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7e61d919-7645-4215-bb3a-db89d382a8bd tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75607ac790>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:51.096837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7e61d919-7645-4215-bb3a-db89d382a8bd tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 202 len: 0 microversion: 2.1 time: 0.077837 Sep 12 14:18:51.097401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 393/778] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:18:51 2022] DELETE /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:18:51.107175 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6347603a-e8ad-40c3-b207-fd1449ebe47a tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f7560956940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:51.163580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6347603a-e8ad-40c3-b207-fd1449ebe47a tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 200 len: 344 microversion: 2.1 time: 0.061644 Sep 12 14:18:51.164330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 386/779] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:18:51 2022] GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:51.757165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:51.757790 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:51.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:51.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:51.766061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:51.767209 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:51.767516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:51.767940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:51.898749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:51.907599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9c9fc29f-b9cd-4389-aef9-ef2a4839735d tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.153837 Sep 12 14:18:51.908053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 394/780] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:51 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:52.059829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18eda8b-a268-43ab-a01a-1c32cd33a294", "tag": "b2fa8bcd-6303-4882-9b72-12e99c78a342"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:52.071916 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.072396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.072826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.087688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] Creating event network-changed:b2fa8bcd-6303-4882-9b72-12e99c78a342 for instance e18eda8b-a268-43ab-a01a-1c32cd33a294 on hv-cinder-82002 Sep 12 14:18:52.092483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2173deb3-48ba-4505-82f0-74970057456c req-3519d22e-0538-467f-9bd4-411de3314a41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107190 Sep 12 14:18:52.093130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 387/781] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:52.154444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.155093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:52.161097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.161644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.162136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.162905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.163422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.163921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.178585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26d55bd7-d02a-401e-b1c4-b88b4c082e57 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75609565e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.189568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:18:52.212086 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-26d55bd7-d02a-401e-b1c4-b88b4c082e57 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] HTTP exception thrown: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26d55bd7-d02a-401e-b1c4-b88b4c082e57 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Request method failure captured: Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f HTTP/1.1 Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz_E6-07swno548OBCapfo35_pK5MXYG_A-QFyyOMZun_B3GBn4cGD-kGdqnCNSUpByIU7lyciIn5_v7UVVJNtio-IpVEKI9JNc-ZXiQfCCs4Mr8xkqCWs_ppo3iKNqZqn_MPFavuuIGu8YSIDv1KYx59p_eKmCfVj4ilKC-9mbxYnM Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:52.214694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983920985ad438a8725654371ffbe4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983920985ad438a8725654371ffbe4f", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e6555c0ef9444e40a87b6f2351b408c1 Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '6c3bf278-3492-4b3c-9a89-1048009a031f'} Sep 12 14:18:52.216173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. (HTTP 404) (Request-ID: req-c3a0b047-0a18-4f1d-bcb2-870fb7d8f3fa) Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.217055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:52.218396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 14:18:52.219842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26d55bd7-d02a-401e-b1c4-b88b4c082e57 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Returning 404 to user: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26d55bd7-d02a-401e-b1c4-b88b4c082e57 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 404 len: 109 microversion: 2.1 time: 0.042269 Sep 12 14:18:52.221149 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 388/782] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:18:52 2022] GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:18:52.229742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b2c7920-ee1c-412f-95aa-aea49085c4ae tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75609b63a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.261206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2b2c7920-ee1c-412f-95aa-aea49085c4ae tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] HTTP exception thrown: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b2c7920-ee1c-412f-95aa-aea49085c4ae tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Request method failure captured: Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f HTTP/1.1 Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz_E6-07swno548OBCapfo35_pK5MXYG_A-QFyyOMZun_B3GBn4cGD-kGdqnCNSUpByIU7lyciIn5_v7UVVJNtio-IpVEKI9JNc-ZXiQfCCs4Mr8xkqCWs_ppo3iKNqZqn_MPFavuuIGu8YSIDv1KYx59p_eKmCfVj4ilKC-9mbxYnM Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:52.263250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983920985ad438a8725654371ffbe4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983920985ad438a8725654371ffbe4f", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e6555c0ef9444e40a87b6f2351b408c1 Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '6c3bf278-3492-4b3c-9a89-1048009a031f'} Sep 12 14:18:52.264795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. (HTTP 404) (Request-ID: req-a5a7f91f-4055-4ac8-8207-236b21e1c473) Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.265693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 14:18:52.267704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 14:18:52.269195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b2c7920-ee1c-412f-95aa-aea49085c4ae tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Returning 404 to user: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b2c7920-ee1c-412f-95aa-aea49085c4ae tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 404 len: 109 microversion: 2.1 time: 0.038749 Sep 12 14:18:52.270341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 389/783] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:18:52 2022] DELETE /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 14:18:52.274252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-206a262b-c0ca-4e17-be5d-411e20265a66 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Calling method '.version_select at 0x7f75609313a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.284857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-40f39dbe-5fd4-4d53-8954-5d211639f60f tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 204 len: 0 microversion: 2.1 time: 0.134171 Sep 12 14:18:52.285743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 395/784] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:18:52 2022] DELETE /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:18:52.294759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.295490 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:52.301474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.301960 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.302391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.303174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.303570 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.303989 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.307103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-206a262b-c0ca-4e17-be5d-411e20265a66 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] HTTP exception thrown: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-206a262b-c0ca-4e17-be5d-411e20265a66 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Request method failure captured: Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f HTTP/1.1 Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz_E6-07swno548OBCapfo35_pK5MXYG_A-QFyyOMZun_B3GBn4cGD-kGdqnCNSUpByIU7lyciIn5_v7UVVJNtio-IpVEKI9JNc-ZXiQfCCs4Mr8xkqCWs_ppo3iKNqZqn_MPFavuuIGu8YSIDv1KYx59p_eKmCfVj4ilKC-9mbxYnM Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:52.309080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983920985ad438a8725654371ffbe4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983920985ad438a8725654371ffbe4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983920985ad438a8725654371ffbe4f", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7983920985ad438a8725654371ffbe4f Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1788975745 Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e6555c0ef9444e40a87b6f2351b408c1 Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1788975745-project Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '6c3bf278-3492-4b3c-9a89-1048009a031f'} Sep 12 14:18:52.310365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. (HTTP 404) (Request-ID: req-bb4a2ee5-9031-47e7-b7f8-48ce2f9bba47) Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.311187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 14:18:52.314165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 14:18:52.315519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-206a262b-c0ca-4e17-be5d-411e20265a66 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] Returning 404 to user: Volume 6c3bf278-3492-4b3c-9a89-1048009a031f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-206a262b-c0ca-4e17-be5d-411e20265a66 tempest-VolumesSnapshotsTestJSON-1788975745 tempest-VolumesSnapshotsTestJSON-1788975745-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f" status: 404 len: 109 microversion: 2.1 time: 0.039903 Sep 12 14:18:52.316927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 390/785] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 12 14:18:52 2022] GET /compute/v2.1/os-volumes/6c3bf278-3492-4b3c-9a89-1048009a031f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:52.448229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:52.456634 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a0e5448-9f73-4a62-93db-4e94f50aac69 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1555 microversion: 2.1 time: 0.166005 Sep 12 14:18:52.457251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 396/786] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:52 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:18:52.936754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:52.937507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:52.944079 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.944507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.945161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.945863 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:52.946320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:52.946745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:52.951069 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:53.085159 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:53.092817 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7c3d59d-788e-4523-9666-a9c2eaa69bc0 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.166639 Sep 12 14:18:53.093388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 391/787] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:52 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:53.479518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:53.480130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:53.486924 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:53.487402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:53.487827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:53.488533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:53.488981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:53.489399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:53.623045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:53.630758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1cdf6b03-3646-4025-81fb-598636cb1191 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1555 microversion: 2.1 time: 0.154985 Sep 12 14:18:53.631382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 397/788] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:53 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:54.115155 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:54.115776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:54.122190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:54.122681 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:54.123151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:54.123839 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:54.124294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:54.124719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:54.256060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:54.263824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a1f64d6-c5eb-4dd9-b102-8f2697133380 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.152660 Sep 12 14:18:54.264457 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 392/789] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:54 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:54.653701 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:54.654590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:54.661573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:54.662053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:54.662479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:54.663194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:54.663689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:54.664105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:54.803523 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:54.811850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-59809a81-d0be-4e51-83f1-86d8ba68b274 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1555 microversion: 2.1 time: 0.161862 Sep 12 14:18:54.812412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 398/790] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:54 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:55.286884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:55.287509 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:55.293551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.294036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.294499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.295358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.296270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.296684 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.427098 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:55.435080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a555a85b-2bb6-43e7-ad1f-76cb9477066e tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.152156 Sep 12 14:18:55.435584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 393/791] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:55 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:55.742912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1", "name": "network-vif-deleted", "tag": "c158483b-3937-4578-983a-bbaad6989bb8"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:55.761157 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.761948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.762817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.779352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] Creating event network-vif-deleted:c158483b-3937-4578-983a-bbaad6989bb8 for instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 on hv-cinder-82002 Sep 12 14:18:55.786987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-cb6c4dbf-dd33-4de3-bbad-ea7060f85bd9 req-45f4c7dd-f3d4-4d8d-bb33-a85f7628cba0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048393 Sep 12 14:18:55.787780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 399/792] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:18:55.840716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:55.841483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:55.848701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.849447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.849895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.850600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.851250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.851880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.899677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:55.900185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:55.900669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:55.901404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lazy-loading 'fault' on Instance uuid b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:18:55.951105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c00c7b37ba44aa9ca0e4555d32ec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40918a5eb3134a00999618cb65dedbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:55.960814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04e08cc3-5190-4c1e-a303-18a3faba7998 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 200 len: 1349 microversion: 2.1 time: 0.128728 Sep 12 14:18:55.961388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 394/793] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:55 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 1349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:56.460512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:56.461213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:56.467810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:56.468411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:56.468939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:56.470441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:56.471127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:56.471222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:56.612409 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:56.621249 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-68fc21de-5b2f-4f36-9013-8b6fe22010fe tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.164965 Sep 12 14:18:56.621849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 400/794] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:56 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:56.984762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:56.985451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] [instance: b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:56.987436 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:56.988164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:56.994676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:56.995192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:56.995628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:56.996317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:56.996776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:56.997195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:57.010584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] HTTP exception thrown: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Request method failure captured: Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 HTTP/1.1 Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz8hK83fCkQE4y0j5sZtKRL40LdhuaxFQuhTil6QZHXDo4FFStJqqkhcUB3vQiWzFm9G9TzCpdNJA_lM29ES6LaEIVaZD1KupHNUl44brNZSj_hygOiNLnLwf-WlsJnBoLmc3nL6WeAJegIiTJ8YNLreKJt1OyXCoU1sTswaFW7aBxU Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 40918a5eb3134a00999618cb65dedbbd Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:18:57.012139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40918a5eb3134a00999618cb65dedbbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40918a5eb3134a00999618cb65dedbbd", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 40918a5eb3134a00999618cb65dedbbd Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-802824971 Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-802824971-project Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 67c00c7b37ba44aa9ca0e4555d32ec90 Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-802824971-project Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. Sep 12 14:18:57.013804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1'} Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:18:57.015109 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. Sep 12 14:18:57.017249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:18:57.018779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Returning 404 to user: Instance b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:18:57.018779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cec3df1-0eb7-45db-be84-cf8e4f10325d tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1" status: 404 len: 111 microversion: 2.1 time: 0.033037 Sep 12 14:18:57.018779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 395/795] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:56 2022] GET /compute/v2.1/servers/b7ac43ea-7fd3-4eeb-8fff-55c3cab960d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:18:57.022623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fa49242c-0ccc-4b2f-b6af-f910fa82a589 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] Calling method '.version_select at 0x7f7560770310>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:57.042060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fa49242c-0ccc-4b2f-b6af-f910fa82a589 tempest-TestMinimumBasicScenario-802824971 tempest-TestMinimumBasicScenario-802824971-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1727228308" status: 202 len: 0 microversion: 2.1 time: 0.023119 Sep 12 14:18:57.042886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 401/796] 10.222.0.42 () {58 vars in 1272 bytes} [Mon Sep 12 14:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1727228308 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:18:57.653264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:57.654052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:57.660195 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:57.660673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:57.661103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:57.661780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:57.662227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:57.663012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:57.874548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:57.884264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f14b934-5395-4f8c-b018-908c65078e83 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.234740 Sep 12 14:18:57.885852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 396/797] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:57 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:18:58.250793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18eda8b-a268-43ab-a01a-1c32cd33a294", "name": "network-vif-plugged", "status": "completed", "tag": "b2fa8bcd-6303-4882-9b72-12e99c78a342"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:18:58.261045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:58.261501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:58.262162 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:58.273948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] Creating event network-vif-plugged:b2fa8bcd-6303-4882-9b72-12e99c78a342 for instance e18eda8b-a268-43ab-a01a-1c32cd33a294 on hv-cinder-82002 Sep 12 14:18:58.279186 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-ab071df4-9d5e-461c-838b-7a6f08b58f43 req-0fcdd7c6-44d2-4185-b657-c127fb0d35f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216419 Sep 12 14:18:58.279775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 402/798] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:18:58.745730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:58.747301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:58.754623 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:58.755145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:58.755673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:58.756446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:58.757190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:58.758039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:58.785074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51456c86-4748-44a8-9c4a-66a0c6b90c50 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/ips" status: 200 len: 150 microversion: 2.20 time: 0.231225 Sep 12 14:18:58.791999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 397/799] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Sep 12 14:18:58 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/ips => generated 150 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 14:18:58.910936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:18:58.911710 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:18:58.921967 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:58.923310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:58.923827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:58.924980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:18:58.925573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:18:58.925998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:18:58.941934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:18:59.094623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:18:59.102931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-64023e92-b242-41ca-83fd-99f200e850c4 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.197455 Sep 12 14:18:59.118053 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 403/800] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:18:58 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:00.128105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:00.128986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:00.138542 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:00.139651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:00.156469 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:00.157222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:00.157693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:00.158118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:00.362582 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:00.371065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-abfe381e-dd6c-4ae3-828e-174927bcfed7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1366 microversion: 2.1 time: 0.247302 Sep 12 14:19:00.386829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 398/801] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:00 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:00.893910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:00.894457 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:00.901086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:00.903138 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:00.903724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:00.904673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:00.905264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:00.905962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:00.936170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lazy-loading 'flavor' on Instance uuid f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:19:01.178170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8085aa36-8018-43f8-826a-76f910a06464 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/action" status: 202 len: 0 microversion: 2.20 time: 0.288532 Sep 12 14:19:01.179449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 404/802] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 12 14:19:00 2022] POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:19:01.191312 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:01.192611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:01.207810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.208861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.209618 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:01.210488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.211355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.212139 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:01.395289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:01.396088 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:01.403896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.404682 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.406449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:01.407450 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.408617 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.409814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:01.780569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:01.789341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:01.791151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:01.792553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7d187c2-224c-4467-920c-a26d63fbe00c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.608827 Sep 12 14:19:01.793189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 399/803] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:01 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:01.945658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:01.954623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-26ae9185-1d13-4d22-81a3-a5066289e742 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1557 microversion: 2.1 time: 0.564506 Sep 12 14:19:01.955503 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 405/804] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:01 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1557 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:19:01.979035 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:01.979423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:01.981314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:01.987888 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.989227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.989685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:01.990404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:01.990873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:01.991292 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:02.216950 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49210b3e-bf86-413f-be8a-ebb0cdb7dbcf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242194 Sep 12 14:19:02.217522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 400/805] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 12 14:19:01 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-interface => generated 285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:02.819111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:02.819841 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:02.826135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:02.826613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:02.827068 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:02.827760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:02.828854 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:02.829277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:02.969325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:02.977405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:02.978820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:02.979993 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9dc581d4-86e3-4050-ba83-e267fe338622 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.164920 Sep 12 14:19:02.980541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 406/806] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:02 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:04.006290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:04.006928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:04.014362 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:04.014933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:04.016072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:04.017098 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:04.017661 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:04.018212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:04.036706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18eda8b-a268-43ab-a01a-1c32cd33a294", "tag": "b2fa8bcd-6303-4882-9b72-12e99c78a342"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:04.069811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:04.070526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:04.071212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:04.086809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] Creating event network-changed:b2fa8bcd-6303-4882-9b72-12e99c78a342 for instance e18eda8b-a268-43ab-a01a-1c32cd33a294 on hv-cinder-82002 Sep 12 14:19:04.091980 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-923dbbbe-41cc-4338-928c-438ae748ce2e req-193ce519-e182-4fe4-a72b-7453bb8b8593 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060996 Sep 12 14:19:04.093191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 407/807] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:04.171595 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:04.181866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:04.183428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:04.184551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c8e71917-bf2d-49c0-91ba-b40ce3ec8d9d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.182798 Sep 12 14:19:04.185143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 401/808] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:04 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:05.214350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:05.215557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:05.222928 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:05.223658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:05.228603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:05.229489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:05.230205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:05.231183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:05.422999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:05.432699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:05.434132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:05.435330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-00064a68-9189-431e-8448-88e90782335d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.229178 Sep 12 14:19:05.446872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 408/809] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:05 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:06.463010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:06.464334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:06.471833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:06.472325 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:06.472728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:06.473437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:06.473882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:06.474512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:06.721894 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:06.730082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:06.731574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:06.732759 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e9b54c6-b5a0-47b2-aef5-ea1b704c12f6 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.274547 Sep 12 14:19:06.743215 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 402/810] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:06 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:07.771136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:07.771136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:07.771136 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:07.772398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:07.772832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:07.773447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:07.774251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:07.774773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:07.775186 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:07.936632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:07.945755 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:07.947527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:07.948754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e850f8af-25ac-4fd7-a821-f4e7204720f3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.189821 Sep 12 14:19:07.950051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 409/811] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:07 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:08.977490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:08.978810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:08.986866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:08.988058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:08.988790 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:08.989812 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:08.990422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:08.991228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:09.211736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:09.220658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:09.222089 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:09.223282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62712690-23c3-44b1-a8e8-a3b491714663 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.250698 Sep 12 14:19:09.223832 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 403/812] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:08 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:10.249281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:10.250206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:10.257669 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:10.258524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:10.259201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:10.260182 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:10.260855 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:10.261514 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:10.449067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:10.460383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:10.462315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:10.464078 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-830f7655-4088-4b32-a1bc-5858e5b42f00 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.218664 Sep 12 14:19:10.464850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 410/813] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:10 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:11.491968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:11.493125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:11.500856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:11.501594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:11.502028 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:11.502718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:11.503296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:11.503890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:11.654873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:11.666085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:11.667642 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:11.669188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d88919b-ea05-4c9d-be8e-32c19d2df818 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.181429 Sep 12 14:19:11.670235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 404/814] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:11 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:12.700753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:12.701941 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:12.709293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:12.710313 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:12.710934 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:12.711822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:12.712454 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:12.713024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:12.866635 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:12.876070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:12.878282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:12.880081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8fb4643f-e86d-4484-84f1-66fe64edfba9 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.182966 Sep 12 14:19:12.880841 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 411/815] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:12 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:13.905690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:13.906484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:13.913331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:13.913874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:13.914257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:13.914988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:13.915485 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:13.915885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:14.146609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:14.156111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:14.157837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:14.159256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-544ba59d-9901-4de4-ad25-596ec702d563 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.257735 Sep 12 14:19:14.159929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 405/816] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:13 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:15.185915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:15.187808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:15.195267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:15.196116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:15.196737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:15.197734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:15.198201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:15.198784 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:15.394795 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:15.404097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:15.405893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:15.407331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2d85f7d2-ed28-4adb-9f8e-0c23bf5d905a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.225889 Sep 12 14:19:15.408431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 412/817] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:15 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:16.439188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:16.439921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:16.456956 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:16.457850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:16.458611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:16.464289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:16.465038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:16.466244 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:16.837897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:16.848339 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:16.850576 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:16.852630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e16ee125-4443-458e-b705-372e3b04b9db tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.419376 Sep 12 14:19:16.864196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 406/818] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:16 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:17.878335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:17.878984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:17.893716 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:17.894569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:17.895266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:17.896332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:17.897007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:17.897828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:18.405503 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:18.414539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:18.416043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:18.417471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e89bc463-9c54-4f02-95a6-5636087cbaff tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.543081 Sep 12 14:19:18.426973 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 413/819] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:17 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:19.120479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25d09e63-8d2a-4410-ab24-75c7e4ff448c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Action: 'create', calling method: .version_select at 0x7f7560940d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-305137904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAim/Yw04uCK6Vt7b3StjRGTKP8XGG+OaJn326JPcaLFl0B5HazGACXyfWn6/trRnp5qIPYtP78ig2STGsL8b0TZRKnQlr1pCACqi9Wnma1SUutQ8tvtEMgul5bkuBCxTQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:19.136102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-25d09e63-8d2a-4410-ab24-75c7e4ff448c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Getting quotas for project fd4a527e5cc441f5901536b58d4fe400. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:19:19.139920 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-25d09e63-8d2a-4410-ab24-75c7e4ff448c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Getting quotas for user 0956fadcbd1e4bcd853eaf7cd5115d93 and project fd4a527e5cc441f5901536b58d4fe400. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:19:19.164644 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25d09e63-8d2a-4410-ab24-75c7e4ff448c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.383270 Sep 12 14:19:19.165274 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 407/820] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:19:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:19.460482 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:19.461689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:19.470228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:19.470720 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:19.471180 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:19.471994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:19.472551 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:19.472975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:19.830038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:19.840567 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:19.842108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:19.843541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fb721740-1a0c-4f00-ad95-1df55df5595c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.404680 Sep 12 14:19:19.844247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 414/821] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:19 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:19.862990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:19.863875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:19.871444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:19.872172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:19.872807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:19.873858 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:19.875058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:19.875758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:19.900471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-176d8dc8-0729-4711-9c96-fe6d5ff13873 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/ips" status: 200 len: 145 microversion: 2.1 time: 0.044029 Sep 12 14:19:19.901051 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 408/822] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:19:19 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:19:20.869729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:20.870944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:20.881624 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:20.882513 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:20.883146 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:20.884019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:20.884648 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:20.885221 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:21.085847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:21.097510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:21.099342 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:21.101420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-68302fb2-62d5-4226-8f5b-f4e882cca05a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.235425 Sep 12 14:19:21.102703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 415/823] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:20 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:21.453561 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b0d977a-45d0-47bf-a70b-dc97e1d20566"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:21.456210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:21.464850 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:21.465347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:21.465792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:21.466533 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:21.467235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:21.467727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:21.656100 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:21.875569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-244551f4-b8dd-4ebf-8c12-e81b3d00bc86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426450 Sep 12 14:19:21.876509 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 409/824] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:19:21 2022] POST /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:22.126325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:22.127114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:22.133743 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:22.134229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:22.134665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:22.135566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:22.136026 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:22.136447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:22.314780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:22.323412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:22.325113 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:22.326359 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5c5cc203-dd20-49ff-b4af-5180b3e77d7d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1741 microversion: 2.20 time: 0.204498 Sep 12 14:19:22.327177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 416/825] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:22 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:23.358912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:23.367592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:23.375718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:23.376580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:23.377488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:23.378268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:23.378824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:23.379404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:23.520988 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:23.531460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:23.532894 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:23.534123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6223c68c-7822-4673-ae63-6c214cf92250 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1741 microversion: 2.20 time: 0.182963 Sep 12 14:19:23.534760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 410/826] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:23 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:24.560077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:24.561592 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:24.568432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:24.568918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:24.569673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:24.570232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:24.577777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:24.578532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:24.831511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:24.848073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:24.851566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:24.854251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-eab64202-3f47-440d-8b92-dbf780012ecb tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.297945 Sep 12 14:19:24.854805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 417/827] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:24 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:25.884068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:25.890901 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:25.899716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:25.900253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:25.900652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:25.901365 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:25.901821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:25.902251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:26.122024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "name": "network-vif-plugged", "status": "completed", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:26.135531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:26.136250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:26.136979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:26.149475 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:26.152050 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] Creating event network-vif-plugged:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:19:26.162033 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:26.164810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-8bb04736-6ff2-4934-9031-2d6c61262b2d req-50a64447-908b-4bc0-93a4-51be5b8a03c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047031 Sep 12 14:19:26.166772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:26.172130 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 418/828] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:26.176184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4836b974-cbb0-44e4-8269-9643db559498 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.295817 Sep 12 14:19:26.178246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 411/829] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:25 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:27.202823 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:27.203553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:27.212879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:27.217292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:27.217914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:27.218665 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:27.219327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:27.219753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:27.238439 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:27.384850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:27.402657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:27.406217 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:27.408748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6ee8b6c7-e163-4d3a-b22b-0a4fc9a0cc6e tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.210555 Sep 12 14:19:27.410160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 419/830] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:27 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:28.439313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:28.440548 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:28.454165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:28.459401 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:28.460075 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:28.461097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:28.461722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:28.462470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:28.688915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:28.700249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:28.701704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:28.702945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f47163c3-77cd-44a0-8747-3358886704cd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.268977 Sep 12 14:19:28.703509 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 412/831] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:28 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:29.690765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:29.697853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:29.705578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.706383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.707024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.708020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.708694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.709350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.730967 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:29.732193 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:29.735460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:29.740686 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.741446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.742123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.743096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.743771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.744409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.753760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-676b4c3a-bd9b-4896-9904-4a2c6fc79056 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067975 Sep 12 14:19:29.767311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 420/832] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:19:29 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:29.773398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:29.774772 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:29.781288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.782531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.783230 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.784144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:29.784789 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:29.785401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:29.838629 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b235739b-7c5d-464f-a8d5-793b6ac632c7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566" status: 200 len: 194 microversion: 2.1 time: 0.069667 Sep 12 14:19:29.841647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 421/833] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 12 14:19:29 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:29.924784 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:29.939778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:29.941673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:29.943444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fcaecdb-65b7-4f81-a776-53fc165faa63 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.217721 Sep 12 14:19:29.947944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 413/834] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:29 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:30.971046 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:30.971673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:30.979742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:30.980292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:30.980735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:30.981504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:30.981969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:30.982492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:31.135073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:31.143578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:31.145083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:31.146302 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-841d7e5d-1b33-488a-806c-a2a6662ffab7 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.180094 Sep 12 14:19:31.146871 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 422/835] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:30 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:19:31.279507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95657626-1757-493d-8147-69bb664c904f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:31.281944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:31.290081 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:31.290915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:31.291535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:31.292422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:31.293085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:31.293925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:31.638137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a2fa148-6677-4c9d-9339-d1baf958fde3 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "POST /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364231 Sep 12 14:19:31.645164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 414/836] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:19:31 2022] POST /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:32.171854 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:32.173212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:32.180021 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:32.180501 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:32.180929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:32.181623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:32.182091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:32.182603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:32.356048 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:32.366382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:32.367826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:32.368966 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8d98f00a-43c4-437b-88ae-3b29ddf21524 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.201862 Sep 12 14:19:32.369517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 423/837] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:32 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:33.397400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:33.398020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:33.408031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:33.410411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:33.411202 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:33.411882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:33.413000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:33.413462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:33.413887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:33.560024 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:33.575598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:33.577114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:33.578296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-999b0303-2567-4b4f-8b5b-669d402c94aa tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.185994 Sep 12 14:19:33.578869 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 415/838] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:33 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:34.604044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:34.604610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:34.612297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:34.613976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:34.621598 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:34.622651 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:34.623156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:34.623585 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:34.784343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:34.789263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:34.790685 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:34.791905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d86a8c77-73b0-4b42-9ba5-8e77bf86c13b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1736 microversion: 2.20 time: 0.191822 Sep 12 14:19:34.792467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 424/839] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:34 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:35.826252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:35.827163 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:35.834032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:35.834528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:35.834996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:35.835700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:35.836333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:35.836761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:35.983875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:35.994957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:35.996614 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:35.997882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c034d52-ce2b-47be-963b-c5ba8c587820 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1718 microversion: 2.20 time: 0.180697 Sep 12 14:19:35.998528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 416/840] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:35 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:37.024322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:37.025181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:37.032802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:37.033286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:37.033715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:37.034403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:37.034869 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:37.035423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:37.165305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:37.173360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:37.174779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:37.175944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-32f12417-b56b-4831-94f1-ed0e672b5517 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1718 microversion: 2.20 time: 0.156096 Sep 12 14:19:37.176514 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 425/841] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:37 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:37.334744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-970070625", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-305137904", "security_groups": [{"name": "tempest-secgroup-smoke-1967732618"}], "networks": [{"uuid": "98b067c7-82fa-413d-adcc-f0e586f1987e"}], "block_device_mapping_v2": [{"uuid": "6aa16630-a61f-4141-9760-1a4203a05eb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:37.451185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] validate_networks() for [('98b067c7-82fa-413d-adcc-f0e586f1987e', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:19:37.829685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:19:37.830117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:19:37.830765 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:19:37.831240 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:19:37.831853 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:19:37.840844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:37.841328 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:37.841756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:37.843038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:37.843487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:37.843907 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:37.860702 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Getting quotas for project fd4a527e5cc441f5901536b58d4fe400. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:19:37.864624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Getting quotas for user 0956fadcbd1e4bcd853eaf7cd5115d93 and project fd4a527e5cc441f5901536b58d4fe400. Resources: {'cores', 'instances', 'ram'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:19:37.927489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:19:37.930206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aa16630-a61f-4141-9760-1a4203a05eb4',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:19:38.058577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdc81d5b-08d9-41cd-937d-b875d33f8e72 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731373 Sep 12 14:19:38.059254 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 417/842] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:19:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:19:38.070724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5164ef4e-2f5c-4aa5-ab12-f6c61c98a717 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:38.071453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5164ef4e-2f5c-4aa5-ab12-f6c61c98a717 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:38.076814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=34 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:38.128546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5164ef4e-2f5c-4aa5-ab12-f6c61c98a717 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:38.135661 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5164ef4e-2f5c-4aa5-ab12-f6c61c98a717 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1087 microversion: 2.1 time: 0.068918 Sep 12 14:19:38.136156 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 426/843] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:38 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:38.206455 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:38.207272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:38.215117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:38.215680 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:38.216221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:38.217026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:38.218152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:38.218577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:38.380859 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:38.394800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:38.400203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:38.409554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee6ee117-8dec-4bb5-82e7-984e2a986f2f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1718 microversion: 2.20 time: 0.201456 Sep 12 14:19:38.410405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 418/844] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:38 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1718 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:39.158546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:39.159206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.167310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.168357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.169199 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.170358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.171516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.172097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.246672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:39.254796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a311208d-88eb-45a1-b390-baf40d010ceb tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1129 microversion: 2.1 time: 0.101231 Sep 12 14:19:39.255380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 427/845] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:39 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1129 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:39.280979 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:39.283238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.289341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.289837 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.290274 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.291003 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.291451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.291867 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.322771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba3ac608-1823-4148-b80d-ea6fccb82b0d tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045693 Sep 12 14:19:39.323347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 419/846] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:19:39 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:39.436324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:39.436853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.442782 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.443292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.443725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.444413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.444859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.445274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.485005 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:39.485957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.493015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.493978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.494622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.495578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.496585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.497221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.558541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc677c22-758d-4926-b434-51ad993dfcf7 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566" status: 200 len: 194 microversion: 2.1 time: 0.081134 Sep 12 14:19:39.559404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 420/847] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 12 14:19:39 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:39.570229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:39.571261 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.585407 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.586484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.587241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.588054 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.588543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.588999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.628884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:39.638333 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:39.639962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:39.641118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-63fb0a29-934b-442f-9f39-999db82c3d31 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1721 microversion: 2.20 time: 0.209065 Sep 12 14:19:39.641845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 428/848] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:39 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:39.666503 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84a3c8b1-53a7-4f85-afca-c792bea81024"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:39.668962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:39.676194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.676407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.683460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.684225 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:39.684880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:39.685315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:39.686433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'services' on Instance uuid a394905a-e979-41eb-9861-ea58c9a875d5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:19:39.775346 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5cb88482-33d3-49d5-936b-869d5909533e tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566" status: 202 len: 0 microversion: 2.1 time: 0.208961 Sep 12 14:19:39.775938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 421/849] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:19:39 2022] DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/5b0d977a-45d0-47bf-a70b-dc97e1d20566 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:19:40.004602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c33ad4ba-8b04-4c00-a60b-20a581cfd8ce tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.342074 Sep 12 14:19:40.005192 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 429/850] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Sep 12 14:19:39 2022] POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 14:19:40.078952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "name": "network-vif-unplugged", "status": "completed", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:40.090936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.091419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.091842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.107732 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] Unable to find a host for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf. Dropping event network-vif-unplugged {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 14:19:40.109304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e6c29781-8b2c-40d0-9978-65c07c1e1b28 req-4861e8fb-bdf2-4e1c-9610-5e5e5a93d3fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036166 Sep 12 14:19:40.110329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 422/851] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 12 14:19:40.193235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:40.193733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:40.201154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.202185 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.202632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.203384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.203833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.204248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.238350 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:40.238984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:40.245472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.245947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.246391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.247095 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.247541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.247961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.274050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-946aab72-a6c6-49ae-b203-e96113460aac tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/ips" status: 200 len: 150 microversion: 2.1 time: 0.039872 Sep 12 14:19:40.274884 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 423/852] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 12 14:19:40 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:40.279071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:40.279676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:40.286200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.286543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.287168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.287896 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.288439 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.288941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.359223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:40.367376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3a4094a-1cba-4d8d-8f67-e8c86a9ea185 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1203 microversion: 2.1 time: 0.091700 Sep 12 14:19:40.367969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 424/853] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:40 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1203 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:40.495191 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a53f5e3-bdc4-44ff-b048-a8018dce90b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments/84a3c8b1-53a7-4f85-afca-c792bea81024" status: 202 len: 0 microversion: 2.20 time: 0.305897 Sep 12 14:19:40.496669 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 430/854] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Sep 12 14:19:40 2022] DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments/84a3c8b1-53a7-4f85-afca-c792bea81024 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:19:40.613189 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:40.613916 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:40.627927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.628425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.628861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.629566 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.630018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.630591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.633984 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:40.687813 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 14:19:40.756378 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf2d3064-5fb3-43ff-8762-8ab7a5dd72f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/action" status: 202 len: 0 microversion: 2.20 time: 0.157107 Sep 12 14:19:40.756936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 425/855] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 12 14:19:40 2022] POST /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:19:40.765546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:40.766160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:40.772150 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.772629 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.773059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.773747 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:40.774200 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:40.774620 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:40.984158 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:40.988075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:40.995311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:40.997089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:40.998270 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dd5b1d27-1f62-4647-9206-ee7041f27751 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1669 microversion: 2.20 time: 0.237188 Sep 12 14:19:41.000093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 431/856] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:40 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:41.391845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:41.392679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:41.401288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:41.402766 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:41.404725 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:41.411706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:41.411992 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:41.412628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:41.713363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:41.722921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21c52629-04ed-402d-adcc-78f47a65b832 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1271 microversion: 2.1 time: 0.335784 Sep 12 14:19:41.723518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 426/857] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:41 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1271 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:41.723908 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "265d75c0-51ca-4601-b555-07fc1f695fdb"}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:41.727274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:41.740981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:41.741471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:41.742385 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:41.743299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:41.743931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:41.744605 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.022268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:42.022774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:42.036449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.036821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.037264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.037973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.038693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.039153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.078679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0478668-9a0d-47df-82f4-9bb30582a430 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/95657626-1757-493d-8147-69bb664c904f" status: 200 len: 194 microversion: 2.1 time: 0.060618 Sep 12 14:19:42.083187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 427/858] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 12 14:19:42 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/95657626-1757-493d-8147-69bb664c904f => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:42.090517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:42.091559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:42.098532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.102700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.103564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.104563 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.105253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.105943 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.157037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-af057512-3a11-48d9-b436-8b6ade750be7 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "POST /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439446 Sep 12 14:19:42.158076 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 432/859] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 12 14:19:41 2022] POST /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:19:42.180957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:42.182473 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:42.191848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.192666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.193109 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.193819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.194645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.195097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.351114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:42.357664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'services' on Instance uuid a394905a-e979-41eb-9861-ea58c9a875d5 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:19:42.361168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:42.364692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:42.366364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6560b12b-1167-479e-9b87-9e657da68b03 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1669 microversion: 2.20 time: 0.281931 Sep 12 14:19:42.367308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 428/860] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:42 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:42.454765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9ea4d768-5263-434d-8962-4aad69646f7c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/95657626-1757-493d-8147-69bb664c904f" status: 202 len: 0 microversion: 2.1 time: 0.294946 Sep 12 14:19:42.459399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 433/861] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:19:42 2022] DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments/95657626-1757-493d-8147-69bb664c904f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:19:42.461261 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:19:42.474695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.475533 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.485363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.511666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] Creating event network-changed:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:19:42.521543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-68de58b1-174f-4085-8d0b-5433018daf9d req-27a315c0-3b7f-4d08-a3b0-e0b66a31fdf5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067314 Sep 12 14:19:42.522410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 429/862] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:19:42.746910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:42.747827 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:42.755311 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.755785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.756348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.756893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:42.757343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:42.757761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:42.902159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:42.910148 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d32c5cec-42e0-4767-a182-a4cbe067be2c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.168231 Sep 12 14:19:42.910723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 434/863] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:42 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:43.395634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:43.397011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:43.404398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:43.405629 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:43.406150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:43.407108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:43.407831 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:43.408687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:43.540027 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:43.548560 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:43.550050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:43.551464 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73995c22-5bca-4339-8e94-56faf12e7853 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.161394 Sep 12 14:19:43.551977 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 430/864] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:43 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:43.933848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:43.934544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:43.942350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:43.942971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:43.943613 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:43.944497 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:43.945089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:43.945524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:44.079058 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:44.088954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-12e9c60a-e1d1-4898-9dd2-89a65164890a tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.158902 Sep 12 14:19:44.094535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:43 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:44.579093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:44.580462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:44.587746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:44.588289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:44.588906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:44.589770 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:44.590225 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:44.590647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:44.752153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:44.762072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:44.763917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:44.767086 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-401d7dc4-3e38-4780-ba59-66d22f15b575 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.193744 Sep 12 14:19:44.767885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 431/866] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:44 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:19:45.112132 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:45.112741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:45.119274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:45.119754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:45.120181 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:45.120868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:45.121315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:45.121733 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:45.258880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:45.268502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c6e05b72-cb6e-4595-b3d8-41b26d27a559 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.160646 Sep 12 14:19:45.269088 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 436/867] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:45 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:45.793549 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:45.794206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:45.800516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:45.801001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:45.801429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:45.802119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:45.802565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:45.803015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:45.939271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:45.947474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:45.948906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:45.950084 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-819dc7be-2f53-41b1-ba8e-448b6bd73f04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.160482 Sep 12 14:19:45.950648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 432/868] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:45 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:19:46.291747 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:46.292692 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:46.299405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:46.299920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:46.300354 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:46.301054 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:46.301504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:46.301928 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:46.441442 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:46.449508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b781c0d9-8c3b-4735-be29-a35b12b85582 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.161984 Sep 12 14:19:46.450190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 437/869] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:46 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:46.976600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:46.977305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:46.984459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:46.985253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:46.985880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:46.987240 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:46.987758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:46.988244 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:47.136349 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:47.145512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:47.148129 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:47.149690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a32b2d38-5567-4388-b794-84c92e1bf4de tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.176800 Sep 12 14:19:47.150423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 433/870] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:46 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:47.473163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:47.473761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:47.480852 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:47.481364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:47.482057 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:47.482780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:47.483281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:47.483913 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:47.634708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:47.643468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4566a258-9d73-4b6f-a04d-1842e98579d3 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.174866 Sep 12 14:19:47.644887 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 438/871] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:47 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:48.175845 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:48.177042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:48.183696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:48.184576 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:48.188173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:48.188862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:48.189499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:48.190227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:48.190735 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:48.191187 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:48.418780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:48.429354 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:48.431090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:48.432459 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da3b1576-1d3a-48b7-8116-8ff5188be261 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.260768 Sep 12 14:19:48.433500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 434/872] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:48 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:48.666195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:48.667664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:48.674689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:48.677077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:48.677653 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:48.678111 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:48.679010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:48.679472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:48.679901 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:48.880462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:48.889918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0bc64559-4fc5-456f-8b1b-dee4d9ac8ced tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.228032 Sep 12 14:19:48.894201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:48 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:49.458414 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:49.459184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:49.466105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:49.466591 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:49.467693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:49.468394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:49.468929 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:49.469530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:49.643164 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:49.652665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:49.654112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:49.655976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2144babd-effb-42e2-9367-8acd43a24773 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.201709 Sep 12 14:19:49.656541 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 435/874] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:49 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:49.917420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:49.918037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:49.925603 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:49.926119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:49.926502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:49.927223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:49.927845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:49.928431 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:50.079896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:50.093256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-824ecdad-80df-4f3d-b558-3950c6720a8f tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.180115 Sep 12 14:19:50.094038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 440/875] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:49 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:50.681246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:50.681851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:50.689259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:50.689752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:50.690185 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:50.690937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:50.691396 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:50.691818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:50.831270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:50.840495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:50.841991 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:50.843174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e0606ff-6b54-4843-9fde-3f23b5cc1d41 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.165894 Sep 12 14:19:50.844606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 436/876] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:50 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:51.117139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:51.118514 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:51.132555 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:51.133462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:51.134137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:51.135123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:51.135803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:51.136467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:51.285915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:51.297892 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d170cac7-86dc-4827-bb35-8a2281fbdf86 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.184668 Sep 12 14:19:51.298650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 441/877] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:51 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:51.871336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:51.871934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:51.878375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:51.878868 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:51.879305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:51.879986 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:51.880440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:51.880860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:52.012337 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:52.021018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:52.022460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:52.023650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5f99da3-3fa1-4be0-868a-9aad1c187453 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.156236 Sep 12 14:19:52.024210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 437/878] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:51 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:52.324221 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:52.324842 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:52.331917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:52.332413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:52.332926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:52.333545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:52.333998 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:52.334423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:52.463737 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:52.471396 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-196da30c-58cd-46ab-8c6c-348e59ac6f6e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.150907 Sep 12 14:19:52.471957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 442/879] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:52 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:19:53.050197 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:53.050806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:53.057249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:53.057723 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:53.058153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:53.058860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:53.059314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:53.059736 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:53.185238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:53.193805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:53.195297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:53.196437 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9daab6a-2a53-4feb-88ae-33dc07f03d2d tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.150828 Sep 12 14:19:53.196983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 438/880] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:53 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:53.494335 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:53.494972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:53.501377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:53.501855 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:53.502288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:53.503010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:53.503463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:53.503881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:53.634279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:53.642773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a7c4524f-076f-40dd-a50d-6a0b0cebaa4d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.152272 Sep 12 14:19:53.643376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 443/881] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:53 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:54.221462 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:54.222045 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:54.228340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:54.228823 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:54.229248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:54.229931 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:54.230378 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:54.230793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:54.363775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:54.372116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:54.373593 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:54.374772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ece63a9-ed29-43cb-800a-5f367d67cb04 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.157255 Sep 12 14:19:54.375353 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 439/882] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:54 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:54.664905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:54.665425 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:54.672299 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:54.672779 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:54.673210 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:54.673912 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:54.674367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:54.674800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:54.805112 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:54.812848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-36f4a373-7e84-4b63-98f1-8a1fe83dc8ef tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.151864 Sep 12 14:19:54.813408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 444/883] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:54 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:55.399085 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:55.399694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:55.406245 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:55.406864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:55.407171 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:55.407852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:55.408301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:55.408716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:55.542090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:55.551920 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:55.553492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:55.554650 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d59b9b73-b637-4fa3-b274-3bf6104bcc43 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.159409 Sep 12 14:19:55.555256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 440/884] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:55 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:55.835808 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:55.836837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:55.843418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:55.843902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:55.844340 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:55.845034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:55.845489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:55.845914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:55.977202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:55.985486 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4ba5a8a6-9c94-448b-955c-480ba8917c6b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.153535 Sep 12 14:19:55.986060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:55 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:56.580727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:56.581386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:56.588039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:56.588528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:56.588962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:56.590404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:56.590404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:56.592694 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:56.606618 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:56.773965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:56.784046 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:56.785729 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:56.787021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20369e62-6459-4f82-88e1-8bff24b13f11 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.210368 Sep 12 14:19:56.787728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 441/886] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:56 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:57.007907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:57.008556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:57.016409 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:57.016914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:57.017332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:57.018029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:57.018480 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:57.018926 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:57.037682 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:19:57.152580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:57.161024 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-2fbb258b-7191-4125-8484-64081a9a08c6 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.157649 Sep 12 14:19:57.161581 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 446/887] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:57 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:57.812979 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:57.813590 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:57.820243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:57.820814 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:57.821266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:57.821948 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:57.822403 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:57.822823 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:57.958974 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:57.967260 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:57.968691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:57.969834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e28e7e40-4756-41ee-9a4a-15a8bea8eb95 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.161770 Sep 12 14:19:57.970389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 442/888] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:57 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:19:58.183859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:58.184465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:58.191101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:58.191580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:58.192011 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:58.192695 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:58.193145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:58.193564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:58.318749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:58.326447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3e5ba5f2-5d85-4f7f-9a5f-6f50332ae583 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.147017 Sep 12 14:19:58.327047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 447/889] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:58 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:19:58.995567 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:58.996322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:59.005851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:59.006144 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:59.006489 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:59.007315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:59.007662 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:59.008246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:59.144606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:59.152602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:59.154034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:59.155213 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f592532a-b3b6-4355-8801-52ae3d70dcbc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.163554 Sep 12 14:19:59.155773 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 443/890] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:19:58 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:19:59.349063 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:19:59.349788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:19:59.356303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:59.356787 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:59.357220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:59.357904 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:19:59.358868 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:19:59.359288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:19:59.486223 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:19:59.493907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-853895cf-3135-4db0-a7c8-607933a75601 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.148707 Sep 12 14:19:59.494575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:19:59 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:00.184266 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:00.185200 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:00.193355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:00.194015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:00.194700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:00.195492 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:00.196107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:00.196627 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:00.338626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:00.346719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:00.348203 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:00.349364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8210ff67-e9d7-4744-8044-975774574640 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.170858 Sep 12 14:20:00.349926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 444/892] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:00 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:00.518498 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:00.519666 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:00.526269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:00.526751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:00.527205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:00.527896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:00.528351 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:00.528773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:00.720621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:00.728307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d517e956-4295-416c-bf39-a28faac4685e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.214822 Sep 12 14:20:00.728880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 449/893] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:00 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:01.373482 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:01.374218 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:01.380682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:01.381161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:01.381623 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:01.382483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:01.382959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:01.383383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:01.521336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:01.529303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:01.531342 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:01.532491 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c26c42e-86da-4c23-b942-5f271c192b66 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.162861 Sep 12 14:20:01.533050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 445/894] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:01 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:01.752312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:01.753077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:01.759516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:01.760124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:01.760456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:01.761170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:01.761626 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:01.762051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:01.923886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:01.932044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f821c0bd-e87d-4bbc-b728-34deecd724a7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.183531 Sep 12 14:20:01.932584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 450/895] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:01 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:02.557458 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:02.558063 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:02.564699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:02.565174 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:02.565601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:02.566305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:02.566755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:02.567197 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:02.694887 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:02.703054 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:02.704484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:02.705630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17833c79-68dc-42ad-8220-1d31f873b4c8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.152056 Sep 12 14:20:02.706184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 446/896] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:02 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:02.961361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:02.961977 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:02.969028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:02.969509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:02.969940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:02.970623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:02.971105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:02.971532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:03.105615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:03.113215 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-007859f3-9f19-4334-890c-14f82098353c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.155746 Sep 12 14:20:03.113804 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 451/897] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:02 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:03.731419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:03.732032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:03.734811 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:03.741698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:03.742183 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:03.742607 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:03.743316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:03.743793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:03.744207 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:03.873570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:03.882160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:03.883631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:03.884771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-abffac33-408f-49bd-8d30-ec0870165f5f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.157284 Sep 12 14:20:03.885329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 447/898] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:03 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:04.136069 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:04.136757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:04.143050 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:04.143538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:04.143971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:04.144662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:04.145117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:04.145541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:04.272371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:04.280610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-47f74754-7c99-4964-b21d-4555ab2d6d3c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.147997 Sep 12 14:20:04.281179 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 452/899] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:04 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:04.909882 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:04.910493 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:04.917082 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:04.917562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:04.917995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:04.918685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:04.919168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:04.919592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:05.050824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:05.058830 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:05.060333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:05.061739 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e42b173-2917-474f-a1c3-5724dec1c1c0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.155733 Sep 12 14:20:05.062295 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 448/900] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:04 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:05.303224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:05.303770 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:05.310212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:05.310678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:05.311397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:05.312072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:05.312517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:05.312931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:05.441403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:05.448965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c187f828-14d3-43a0-8a5c-54715628963e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.149751 Sep 12 14:20:05.449566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 453/901] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:05 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:06.088940 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:06.089478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:06.095789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:06.096262 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:06.096687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:06.097360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:06.097805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:06.098221 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:06.225086 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:06.233577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:06.235055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:06.236204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f338847-ab82-40bd-8880-92ce167de77f tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.151141 Sep 12 14:20:06.236762 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 449/902] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:06 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:06.473041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:06.473561 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:06.479988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:06.480464 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:06.480890 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:06.481566 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:06.482012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:06.482433 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:06.612276 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:06.620587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-911b9cb9-8192-45fa-81d5-87c274b81523 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.151591 Sep 12 14:20:06.621423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 454/903] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:06 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:07.261626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:07.262242 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:07.269306 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:07.269787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:07.270223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:07.270935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:07.271390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:07.271809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:07.397338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:07.405308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:07.406742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:07.407985 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af1c5aba-41c2-40c3-860b-41c3710d092b tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.150237 Sep 12 14:20:07.408551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 450/904] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:07 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:07.643489 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:07.644014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:07.650337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:07.650810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:07.651269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:07.651951 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:07.652398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:07.652821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:07.790773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:07.799037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5be58b92-3863-469e-834d-03d5d915be45 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.159465 Sep 12 14:20:07.799600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 455/905] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:07 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:08.432912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:08.433517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:08.440442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:08.440928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:08.441362 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:08.442108 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:08.442562 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:08.443021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:08.571947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:08.581151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:08.582612 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:08.583810 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91369530-9f79-4a7f-8701-6c923d40d063 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.154848 Sep 12 14:20:08.584719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 451/906] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:08 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:08.821441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:08.822119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:08.824385 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=62 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:08.830307 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:08.830795 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:08.831256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:08.831952 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:08.832403 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:08.832826 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:08.964398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:08.972040 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-66d53361-891b-462b-a87e-1e8ed02f7b49 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.154450 Sep 12 14:20:08.972611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 456/907] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:08 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:09.610334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:09.610965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:09.617501 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:09.617996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:09.618435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:09.619150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:09.619603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:09.620020 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:09.747476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:09.755596 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:09.757026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:09.758188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28ba6410-1f42-4618-8eb1-540a682cb560 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.152300 Sep 12 14:20:09.758734 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 452/908] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:09 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:09.995047 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:09.995616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:10.002001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:10.002493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:10.002935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:10.003612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:10.004064 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:10.004480 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:10.134222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:10.142424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b276cb56-2dc7-4dcf-b909-dcf1c6967ea8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.151357 Sep 12 14:20:10.143013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 457/909] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:09 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:10.784158 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:10.784700 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:10.791019 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:10.791495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:10.791923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:10.792592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:10.793039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:10.793454 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:10.918162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:10.926721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:10.929207 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:10.930359 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e26a1814-fe85-47e9-9a1f-091b1f909ff0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.150763 Sep 12 14:20:10.930943 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 453/910] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:10 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:11.165096 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:11.165657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:11.173060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:11.173570 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:11.173999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:11.174793 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:11.175196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:11.182527 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:11.302997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:11.311087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7846cbc9-de22-4343-8b19-750a30e9108c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.149570 Sep 12 14:20:11.311659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 458/911] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:11 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:11.956050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:11.956648 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:11.963227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:11.963708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:11.964150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:11.964840 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:11.965296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:11.965721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.095704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:12.103777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:12.105446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:12.106601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6f1cd03-b96a-40f4-b78f-f95560076eb4 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.154984 Sep 12 14:20:12.107191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 454/912] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:11 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:12.333329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:12.334484 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:12.342626 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.343196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.343992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.344707 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.345343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.345933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.469656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:12.470351 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:12.477036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.477778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.478214 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.479141 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.479806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.480227 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.510318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:12.520510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cc74f9c9-4679-4ef4-bd7f-b906f3c44752 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.190962 Sep 12 14:20:12.523717 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 459/913] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:12 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:12.564017 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'services' on Instance uuid e18eda8b-a268-43ab-a01a-1c32cd33a294 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:20:12.640044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28de67cc-a4d2-48f2-8746-d2a5e91a1a46 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments/265d75c0-51ca-4601-b555-07fc1f695fdb" status: 202 len: 0 microversion: 2.1 time: 0.175861 Sep 12 14:20:12.641011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 455/914] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 12 14:20:12 2022] DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments/265d75c0-51ca-4601-b555-07fc1f695fdb => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:20:12.650061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:12.652622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:12.659681 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.660435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.661103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.661783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:12.662251 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:12.662892 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:12.697302 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5e2e0f32-0029-4af2-af71-3ef53cb2fe3a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051662 Sep 12 14:20:12.697874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 460/915] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:20:12 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:20:13.133611 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.134313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.143235 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.143852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.144294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.145513 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.145667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.145998 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.286916 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:13.295128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:13.296584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:13.297742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f45bcb3a-64cb-40fb-a678-408f2e69c0ae tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.168425 Sep 12 14:20:13.298339 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 456/916] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:13.421958 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.424144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.430423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.430949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.431392 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.432086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.432542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.432974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.463057 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b32c3c48-d345-4640-85d0-5b417b7eccfb tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045483 Sep 12 14:20:13.463622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 461/917] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:20:13.543906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.544517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.550411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.550936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.551371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.552059 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.552512 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.552933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.567981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:13.583713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.586320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.593256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.593838 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.594375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.595160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.595680 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.596106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.626914 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dbcc5018-3ef4-4ccc-bfcf-4bfe52b5b798 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047068 Sep 12 14:20:13.627494 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 462/918] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:20:13.687155 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:13.692152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.692658 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.694925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e31e0eb5-242f-440f-9e95-f6fd7b5bdf09 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.154771 Sep 12 14:20:13.695490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 457/919] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:13.698610 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.699232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.699662 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.700377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.700828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.701246 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.705780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=100 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:13.711589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.713859 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.720317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.720796 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.721230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.721914 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.722364 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.722778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.731759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:20:13.821663 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8f574c9f-6fa5-47ab-8de7-172758edbe86 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 204 len: 0 microversion: 2.1 time: 0.132814 Sep 12 14:20:13.825861 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 463/920] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:13 2022] DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:20:13.833864 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.834742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.841362 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.841849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.842327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.843061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.843517 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.843939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.913859 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99260d7a-b5b8-4ef5-86e2-7b90e83831ba tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.206276 Sep 12 14:20:13.914420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 458/921] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 14:20:13.978075 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:13.978566 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:13.980254 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:13.984936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.985411 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.985833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.986509 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:13.986976 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:13.987393 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:13.988520 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ae990f55-a840-4b58-bfeb-eb4d9d6dc300 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1673 microversion: 2.1 time: 0.160449 Sep 12 14:20:13.989077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 464/922] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:13 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:14.011570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:20:14.085436 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b50d8e2c-ecda-491b-a6e4-0a0a776fa2a5 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 204 len: 0 microversion: 2.1 time: 0.110709 Sep 12 14:20:14.085953 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 459/923] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:13 2022] DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 14:20:14.094652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:14.095282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:14.101061 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.101534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.101961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.102636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.103112 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.103530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.234374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:14.242331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-10e24261-a5f4-4e07-85ad-6e42c75b5032 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1681 microversion: 2.1 time: 0.151969 Sep 12 14:20:14.242917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 465/924] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:14 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:14.325854 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:14.327102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:14.334176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.334698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.335169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.335923 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.336315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.336771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.369936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "name": "network-vif-plugged", "status": "completed", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:14.380432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.380907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.381518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.395920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] Creating event network-vif-plugged:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:20:14.401325 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d1140be5-899d-4d8f-8265-e5f5120dffe1 req-28edf985-7864-4f0b-9732-15794ba3caa9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Sep 12 14:20:14.402242 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 466/925] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:20:14.502015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:14.511620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:14.513071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:14.515123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-289e2c5d-01cb-415a-8a6e-436185294409 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.194729 Sep 12 14:20:14.516161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 460/926] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:14 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:14.718539 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:14.719257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:14.725266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.725738 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.726163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.726853 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:14.727304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:14.727723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:14.860659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:14.868449 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e98dbbae-36c6-4891-a94e-ab17423499ab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.154598 Sep 12 14:20:14.869010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 467/927] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:14 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:15.011880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:15.012528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:15.018944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.019426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.019862 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.020546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.021000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.021424 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.144608 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:15.152264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6df48f8-1b9d-4db8-babe-a7a466a46a00 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1673 microversion: 2.1 time: 0.144200 Sep 12 14:20:15.152832 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 461/928] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:15 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:20:15.265805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:15.266418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:15.272437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.272921 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.273355 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.274044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.274496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.274943 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.405082 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:15.413884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1cceff13-d5f9-4a84-b8c4-f2f83462747c tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1681 microversion: 2.1 time: 0.152519 Sep 12 14:20:15.414672 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 468/929] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:15 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:15.540783 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:15.541410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:15.548347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.548824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.549251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.549927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.550375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.550796 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.674800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:15.682780 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:15.684223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:15.685383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b39d3e7c-0713-4fe2-a5c9-98e26e9d2e83 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.148492 Sep 12 14:20:15.686199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 462/930] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:15 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:15.891659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:15.892328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:15.898638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.899151 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.899578 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:15.900253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:15.900700 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:15.901116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.027463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.035654 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-42986be1-5f11-4eec-b4ba-b47522eda57e tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.148529 Sep 12 14:20:16.036206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 469/931] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:15 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:16.175629 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:16.176259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:16.182056 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.182529 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.182993 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.183670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.184117 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.184537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.316677 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.324338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-96825a31-6fff-46c8-832b-3ef3e18fb1ae tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1673 microversion: 2.1 time: 0.152465 Sep 12 14:20:16.324902 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 463/932] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:16 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:16.421447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "name": "network-vif-plugged", "status": "completed", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:16.430596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.431103 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.431529 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.438087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:16.438734 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:16.443509 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] Creating event network-vif-plugged:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:20:16.444655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.445140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.445574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.446271 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.446728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.447184 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.448343 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-6acb257a-54e2-4cec-8fa2-a2e6420e36bb req-ff2e5933-8d99-4868-a098-f1d1c0f6ded1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Sep 12 14:20:16.448936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 470/933] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:20:16.572287 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.580645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a29898b-d934-4b1f-9b16-18fa09d2469a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1681 microversion: 2.1 time: 0.147134 Sep 12 14:20:16.581208 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 464/934] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:16 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:20:16.711256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:16.711986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:16.718740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.719253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.719687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.720376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:16.720832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:16.721257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:16.852376 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.860518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.861956 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:16.863147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-00e0fd65-86a7-4e8b-a284-8deb424619f2 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.156209 Sep 12 14:20:16.863703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 471/935] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:16 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:17.057503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:17.058041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:17.064358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.064900 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.065425 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.066127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.066586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.067049 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.242737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:17.251183 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afec34f5-a60e-4251-b6c6-db8a393d3675 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.197484 Sep 12 14:20:17.251857 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 465/936] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:17 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:17.349708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:17.350453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:17.356870 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.357358 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.357794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.358521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.359594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.359594 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.580596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:17.588819 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3eb31a3a-81eb-4f84-8c0d-4550ecf2a606 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1673 microversion: 2.1 time: 0.243203 Sep 12 14:20:17.589616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 472/937] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:17 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:17.605216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:17.606228 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:17.612427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.612905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.614126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.614289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.614737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.615259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.888134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:17.889320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:17.896274 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.896754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.897180 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:17.897873 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:17.898320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:17.898738 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.168757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.178647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae96f958-92b0-4941-b189-a0f6554875d6 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1681 microversion: 2.1 time: 0.577754 Sep 12 14:20:18.199001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 466/938] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:17 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1681 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:18.206307 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a394905a-e979-41eb-9861-ea58c9a875d5", "name": "network-vif-deleted", "tag": "9a806fa5-8e1e-44d6-ad92-6327e1178def"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:18.219815 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.220300 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.220737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.235090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] Creating event network-vif-deleted:9a806fa5-8e1e-44d6-ad92-6327e1178def for instance a394905a-e979-41eb-9861-ea58c9a875d5 on hv-cinder-82002 Sep 12 14:20:18.243380 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.245936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ff8263f1-c254-4851-98ec-65dcc002df64 req-54b37520-8777-4941-8639-8596bb4d2417 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044514 Sep 12 14:20:18.247004 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 467/939] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:20:18.257860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.259374 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.260584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e2632ccc-1466-425e-9c50-9399729397bd tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.376389 Sep 12 14:20:18.261463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 473/940] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:17 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:20:18.281737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:18.282720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:18.292880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.293387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.293828 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.294635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.295708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.296135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.539206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.559737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16b585a7-8cb1-4a4f-886c-d20fd92e6414 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1259 microversion: 2.1 time: 0.282755 Sep 12 14:20:18.569891 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 468/941] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:18 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:18.612984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:18.613716 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:18.620565 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.621055 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.621882 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.622752 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.623300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.623768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.655822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:18.656312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:18.656759 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:18.657201 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'fault' on Instance uuid a394905a-e979-41eb-9861-ea58c9a875d5 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:20:18.707174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:18.715371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-bef7a49a-4290-4ef8-a8d2-23c759b7c02a tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1327 microversion: 2.1 time: 0.106322 Sep 12 14:20:18.727452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 474/942] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:18 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:19.067451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18eda8b-a268-43ab-a01a-1c32cd33a294", "name": "network-vif-deleted", "tag": "b2fa8bcd-6303-4882-9b72-12e99c78a342"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:19.078631 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.079151 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.079572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.090961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] Creating event network-vif-deleted:b2fa8bcd-6303-4882-9b72-12e99c78a342 for instance e18eda8b-a268-43ab-a01a-1c32cd33a294 on hv-cinder-82002 Sep 12 14:20:19.096958 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0976ac9c-3c10-4cfd-96dc-e6683d3fb747 req-61c350c3-dab9-48eb-b2a8-4887f3b7e170 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335388 Sep 12 14:20:19.097799 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 469/943] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:20:19.206859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:19.207765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:19.214379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.215172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.215767 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.216630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.217348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.217929 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.293760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:19.295570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:19.303128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.303614 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.304253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.305391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.305995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.306603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.317095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.333078 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dca793b2-e747-4d3c-b266-95da578ecaa1 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1325 microversion: 2.1 time: 0.131626 Sep 12 14:20:19.347697 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 475/944] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:19 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:19.548871 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.558031 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.561927 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.563264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c6c2773-404c-4ac8-bef0-8e8954fcb880 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1727 microversion: 2.20 time: 0.274029 Sep 12 14:20:19.563864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 470/945] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:19 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:20:19.589459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:19.590202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:19.597455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.598129 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.598670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.599504 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.600190 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.600820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.739460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:19.740074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:19.748945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.749696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.750282 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.751160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.751987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.752570 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.763227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.772899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-21e4f20b-6344-4743-9208-c7a5cb059727 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1444 microversion: 2.1 time: 0.187721 Sep 12 14:20:19.773820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 476/946] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:19 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1444 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:19.794420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.795531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.795999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.796443 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lazy-loading 'fault' on Instance uuid a394905a-e979-41eb-9861-ea58c9a875d5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:20:19.799208 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:19.799923 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:19.806213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.806875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.807379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.808161 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:19.808678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:19.809176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:19.843885 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cb679ed52e42ca83a2084f1ad4bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c135e354b4262865198bd5c834cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.852125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69ebbfb7-52a6-4723-b473-57007a08a3f1 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 200 len: 1327 microversion: 2.1 time: 0.116399 Sep 12 14:20:19.852704 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 471/947] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:19 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:20:19.958405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:19.968020 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c19b55aa-1453-4c66-b9d1-f4213e408ab2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1444 microversion: 2.1 time: 0.174010 Sep 12 14:20:19.969303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 477/948] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:19 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:20:20.357829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:20.358447 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:20.364782 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.365280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.365718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.366427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.366996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.367429 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.400689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.400912 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.401276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.401733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lazy-loading 'fault' on Instance uuid e18eda8b-a268-43ab-a01a-1c32cd33a294 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:20:20.457535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8e93029f447bb8294d9b516eb407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a72919a47034a2684973f31e4217f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:20.468049 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31652ed3-78a0-4eca-b34e-69dfc36baf7a tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 200 len: 1330 microversion: 2.1 time: 0.113171 Sep 12 14:20:20.468655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 472/949] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:20 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:20.590334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:20.591097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:20.597304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.597790 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.598226 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.598954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.599413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.599833 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.733004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:20.741038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:20.742461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:20.743653 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4268f165-ce86-4913-a10d-3783be472617 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1714 microversion: 2.20 time: 0.157309 Sep 12 14:20:20.744212 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 478/950] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:20 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:20:20.876063 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:20.876699 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:20.883112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.883594 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.884030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.884718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:20.885165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:20.885585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:20.890358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:20.901899 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 HTTP/1.1 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:20.903659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:20.905341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'a394905a-e979-41eb-9861-ea58c9a875d5'} Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:20.906255 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:20.907805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:20.909122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:20.909122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16956065-24fc-471d-b79f-db32414c8225 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 404 len: 111 microversion: 2.1 time: 0.033442 Sep 12 14:20:20.909122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 473/951] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:20 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:20.914393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3161016b-7da8-437f-b0bf-8ce3e0144105 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '.version_select at 0x7f756091c040>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:20.932965 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3161016b-7da8-437f-b0bf-8ce3e0144105 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872400125" status: 202 len: 0 microversion: 2.1 time: 0.022509 Sep 12 14:20:20.933955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 479/952] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 12 14:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872400125 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:20:21.491890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:21.492499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:21.499470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:21.499965 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:21.500663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:21.501361 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:21.501813 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:21.502233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:21.517715 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 HTTP/1.1 Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:21.519205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:21.520626 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'e18eda8b-a268-43ab-a01a-1c32cd33a294'} Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:21.521357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:21.522589 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:21.523685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:21.523685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb9e94f6-0625-4d46-a247-d9e510194768 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 404 len: 111 microversion: 2.1 time: 0.032922 Sep 12 14:20:21.523685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 474/953] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:21 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:21.530331 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c40c7d89-6b2d-4947-8870-d62eb3aa97da tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '.version_select at 0x7f75608da430>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:21.557334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c40c7d89-6b2d-4947-8870-d62eb3aa97da tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501083337" status: 202 len: 0 microversion: 2.1 time: 0.031471 Sep 12 14:20:21.558025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 480/954] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 12 14:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501083337 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:20:22.103249 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:22.114080 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:22.114879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:22.115565 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:22.128012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] Creating event network-changed:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:20:22.133384 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f09f2309-f4d0-4e10-a7a4-594428d81bcf req-dddedbed-6bfb-4172-8fd0-022c72640d27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034225 Sep 12 14:20:22.134311 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 475/955] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:20:23.753783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:23.754316 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:23.761521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.762000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.762432 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.763142 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.764278 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.764699 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.768714 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:23.778458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 HTTP/1.1 Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:23.780124 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.781753 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'e18eda8b-a268-43ab-a01a-1c32cd33a294'} Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:23.782676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.784248 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.785768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:23.785768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-73d7b099-ec35-42ec-90ba-73c0f21d94f8 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 404 len: 111 microversion: 2.1 time: 0.032155 Sep 12 14:20:23.785768 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 481/956] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:23 2022] DELETE /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:23.790775 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:23.791588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: e18eda8b-a268-43ab-a01a-1c32cd33a294] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:23.797653 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.798154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.798587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.799297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.799749 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.800162 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.813880 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 HTTP/1.1 Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:23.815628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.817176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'e18eda8b-a268-43ab-a01a-1c32cd33a294'} Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:23.818032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. Sep 12 14:20:23.819263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.820386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance e18eda8b-a268-43ab-a01a-1c32cd33a294 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:23.820386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac9ba278-62ef-4e32-ade6-8f14b6782735 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294" status: 404 len: 111 microversion: 2.1 time: 0.030898 Sep 12 14:20:23.820386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 476/957] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:23 2022] GET /compute/v2.1/servers/e18eda8b-a268-43ab-a01a-1c32cd33a294 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:23.897483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:23.898059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:23.905545 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.906086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.906524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.907316 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.907770 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.908279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.922655 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 HTTP/1.1 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:23.924224 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.925902 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'a394905a-e979-41eb-9861-ea58c9a875d5'} Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:23.926813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.928308 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.929820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:23.929820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f8a39be9-f519-4317-9dc0-ee193fef8e3f tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 404 len: 111 microversion: 2.1 time: 0.032338 Sep 12 14:20:23.929820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 482/958] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:23 2022] DELETE /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:23.938521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:23.939156 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: a394905a-e979-41eb-9861-ea58c9a875d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:23.945008 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.945484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.945916 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.946593 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:23.947065 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:23.947480 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:23.960499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 HTTP/1.1 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:23.961981 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.963602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'a394905a-e979-41eb-9861-ea58c9a875d5'} Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:23.964467 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. Sep 12 14:20:23.965890 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:23.967248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance a394905a-e979-41eb-9861-ea58c9a875d5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:23.967248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60be27a7-7222-48da-952f-a2d5e24ee0f8 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5" status: 404 len: 111 microversion: 2.1 time: 0.029159 Sep 12 14:20:23.967248 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 477/959] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:23 2022] GET /compute/v2.1/servers/a394905a-e979-41eb-9861-ea58c9a875d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:24.954727 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:24.955286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:24.961590 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:24.962068 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:24.962502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:24.963227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:24.963677 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:24.964100 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:24.977920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 HTTP/1.1 Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:24.979462 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:24.981027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'd4e8856b-07c8-4b63-8ab0-f22e2be080a6'} Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:24.982083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:24.983582 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:24.985119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:24.985119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-49d83680-e59a-4ae7-9bc0-d458f83d20bf tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 404 len: 111 microversion: 2.1 time: 0.030511 Sep 12 14:20:24.985119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 483/960] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:24 2022] DELETE /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:24.988968 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:24.989586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: d4e8856b-07c8-4b63-8ab0-f22e2be080a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:24.995744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:24.996223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:24.996655 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:24.997337 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:24.997841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:24.998397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.013088 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 HTTP/1.1 Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:25.015135 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:25.016758 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd4e8856b-07c8-4b63-8ab0-f22e2be080a6'} Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:25.017720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. Sep 12 14:20:25.019226 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.020719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance d4e8856b-07c8-4b63-8ab0-f22e2be080a6 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:25.020719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f7e97b9-8210-4df3-aef6-2f03b9dc1350 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6" status: 404 len: 111 microversion: 2.1 time: 0.031377 Sep 12 14:20:25.020719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 478/961] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:24 2022] GET /compute/v2.1/servers/d4e8856b-07c8-4b63-8ab0-f22e2be080a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:25.024879 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:25.025357 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:25.031846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.032326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.032760 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.033445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.033897 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.034320 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.049290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 HTTP/1.1 Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:25.050816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.052391 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'c4d0572f-025c-430b-87d7-83f02ec83568'} Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:25.053288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.054650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.056220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:25.056220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-904a7d0a-d734-4dc0-bac6-7fcd6ee2d63b tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 404 len: 111 microversion: 2.1 time: 0.031138 Sep 12 14:20:25.056220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 484/962] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:25 2022] DELETE /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:25.062472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:25.063213 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: c4d0572f-025c-430b-87d7-83f02ec83568] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:25.069333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.069898 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.070410 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.071214 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.071743 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.072241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.087319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 HTTP/1.1 Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:25.088774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.090316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'c4d0572f-025c-430b-87d7-83f02ec83568'} Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:25.091170 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. Sep 12 14:20:25.092499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.093691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance c4d0572f-025c-430b-87d7-83f02ec83568 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:25.093691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cac18e1b-72de-4bfb-881e-2c347c9c1052 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568" status: 404 len: 111 microversion: 2.1 time: 0.033005 Sep 12 14:20:25.093691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 479/963] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:25 2022] GET /compute/v2.1/servers/c4d0572f-025c-430b-87d7-83f02ec83568 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:25.123788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:25.124290 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:25.131115 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.131606 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.132062 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.132783 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.133216 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.133639 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.149858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 HTTP/1.1 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:25.151444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.153045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '58855138-24d4-43f5-bbf2-c470cb31e738'} Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:25.153932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.155412 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.156813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:25.156813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9418442f-989f-4bb5-bbae-dd0f9e24d720 tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 404 len: 111 microversion: 2.1 time: 0.035284 Sep 12 14:20:25.159086 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 485/964] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:25 2022] DELETE /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:25.169137 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:25.170128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] [instance: 58855138-24d4-43f5-bbf2-c470cb31e738] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:25.176692 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.177196 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.177685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.178442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:25.178982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:25.179478 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:25.194128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] HTTP exception thrown: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Request method failure captured: Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 HTTP/1.1 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6CPYEm5h9VEeQYW9pIaB05dIqBpMzHtv2-ulN522C-psDFppdfBu0u17LFl-WddH6J21_-oXWkDNgkthk1QveJacDAvtdOkqSSp5TuHehuqH-RvBXUle8xcKrvhrLhx_yyPIBAjF1hty_uAtvqVLMKlU1CRdEtSoiu0a7VBskXOEY Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:25.195768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613c135e354b4262865198bd5c834cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613c135e354b4262865198bd5c834cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613c135e354b4262865198bd5c834cb1", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 613c135e354b4262865198bd5c834cb1 Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1681784671 Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: e7cb679ed52e42ca83a2084f1ad4bd92 Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1681784671-project Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.197486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '58855138-24d4-43f5-bbf2-c470cb31e738'} Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:25.198409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. Sep 12 14:20:25.200289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:25.202380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] Returning 404 to user: Instance 58855138-24d4-43f5-bbf2-c470cb31e738 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:25.202380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2be6bdb2-b3ab-4230-9e0c-93a1568aa09c tempest-AttachVolumeTestJSON-1681784671 tempest-AttachVolumeTestJSON-1681784671-project] 10.222.0.42 "GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738" status: 404 len: 111 microversion: 2.1 time: 0.035187 Sep 12 14:20:25.202380 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 480/965] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:25 2022] GET /compute/v2.1/servers/58855138-24d4-43f5-bbf2-c470cb31e738 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:26.250675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:26.251394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:26.258073 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:26.258652 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:26.259202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:26.259986 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:26.260516 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:26.261013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:26.276806 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f HTTP/1.1 Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:20:26.278458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.280749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'bb08f5b9-cb33-43b9-a82c-116ad362579f'} Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:26.281659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.283459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.284703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:26.284703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fdbd6df2-67a9-42e0-b947-24a09b320349 tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 404 len: 111 microversion: 2.1 time: 0.034717 Sep 12 14:20:26.286332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 486/966] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:20:26 2022] DELETE /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:26.290669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:26.292119 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] [instance: bb08f5b9-cb33-43b9-a82c-116ad362579f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:26.298366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:26.298863 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:26.299293 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:26.299978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:26.300427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:26.300864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:26.314698 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] HTTP exception thrown: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Request method failure captured: Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f HTTP/1.1 Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6I2tYRRk6yQ74Xw6Vf9cfmCgntv1_E4WmOlZlANEeuadGl3zorj128aZqjHU9PQmAp9E_J9Iih0UqZDHGy5AqBoYG0Q7k4Y99hxwy6Rsr7n7m1Y_bnWxP77pRAesLAenF9GWPAxTsg21FDT_vHV0vY1ny0QQYtOJ2WbsHJwxRcTTU Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:20:26.316305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4a72919a47034a2684973f31e4217f3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4a72919a47034a2684973f31e4217f3e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4a72919a47034a2684973f31e4217f3e Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-720788973 Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: fff8e93029f447bb8294d9b516eb407f Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-720788973-project Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.317847 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'bb08f5b9-cb33-43b9-a82c-116ad362579f'} Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:20:26.319018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. Sep 12 14:20:26.320463 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:20:26.322331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] Returning 404 to user: Instance bb08f5b9-cb33-43b9-a82c-116ad362579f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:20:26.322331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-461df642-4373-4c6c-87f2-39e9e90869ec tempest-AttachVolumeNegativeTest-720788973 tempest-AttachVolumeNegativeTest-720788973-project] 10.222.0.42 "GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f" status: 404 len: 111 microversion: 2.1 time: 0.030859 Sep 12 14:20:26.322331 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 481/967] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:26 2022] GET /compute/v2.1/servers/bb08f5b9-cb33-43b9-a82c-116ad362579f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:20:53.055750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-591851355", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "networks": [{"uuid": "ce8cfc23-dc23-4de7-a589-9e5ac5e263d6"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:53.065273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:53.065915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=10 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:53.112466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] validate_networks() for [('ce8cfc23-dc23-4de7-a589-9e5ac5e263d6', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:20:53.520653 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:20:53.521067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:20:53.521535 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:20:53.521935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:20:53.522360 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:20:53.531650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:53.532123 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:53.532548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:53.533277 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:53.533723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:53.534140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:53.553169 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Getting quotas for project 7a92484ba35b46b6bd86a3072403410e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:20:53.557165 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Getting quotas for user 4c26b531c07a498c9617c9ee2f7bf7e9 and project 7a92484ba35b46b6bd86a3072403410e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:20:53.568034 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:20:53.570288 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:20:53.615081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-07745948-1821-442d-bf00-9171892cecda tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563113 Sep 12 14:20:53.615648 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 487/968] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:20:53.627148 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5dd9b63-1f47-49de-8564-ac55e1327006 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:53.627861 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5dd9b63-1f47-49de-8564-ac55e1327006 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:53.631192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:53.631954 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=17 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:20:53.686007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5dd9b63-1f47-49de-8564-ac55e1327006 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:53.692917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5dd9b63-1f47-49de-8564-ac55e1327006 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1213 microversion: 2.1 time: 0.069750 Sep 12 14:20:53.693471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 482/969] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:53 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:54.716962 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:54.717838 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:54.725608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:54.725608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:54.727250 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:54.728133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:54.729147 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:54.729558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:54.828188 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:54.838803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b0c184ea-57c7-49a6-84d0-f4edacae1522 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1273 microversion: 2.1 time: 0.127058 Sep 12 14:20:54.839741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 488/970] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:54 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:55.862011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:55.862624 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:55.868685 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:55.869163 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:55.869592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:55.870276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:55.870757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:55.871216 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:55.932486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:55.940406 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c22e04e9-6c1d-4a26-be85-e5274a026404 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1271 microversion: 2.1 time: 0.082237 Sep 12 14:20:55.940959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 483/971] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:55 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:56.963070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:56.963675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:56.970690 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:56.971192 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:56.971623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:56.972297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:56.972742 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:56.973159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:57.036133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:57.043872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6d7903a1-d5d9-4aa8-8dd7-41caa0108f5d tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1271 microversion: 2.1 time: 0.084692 Sep 12 14:20:57.044437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 489/972] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:56 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:58.068658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:58.069313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:58.077422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:58.077905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:58.078339 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:58.079062 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:58.079542 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:58.079963 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:58.273210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:58.281176 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75d5481c-52b3-4e06-9718-2d115071f392 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.216472 Sep 12 14:20:58.281752 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 484/973] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:58 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:58.811332 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "054af95e-5fe2-49a9-a89c-261804389538", "tag": "03ad01e7-a431-482c-8631-0b48a6dc5b06"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:20:58.837393 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:58.838106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:58.839402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:58.851521 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] Creating event network-changed:03ad01e7-a431-482c-8631-0b48a6dc5b06 for instance 054af95e-5fe2-49a9-a89c-261804389538 on hv-cinder-82002 Sep 12 14:20:58.857067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-e90fd2dc-a745-4f35-acab-dad2ca6a9a7d req-b2558e0f-29d6-44cc-9af0-0a7fc6d9beac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049682 Sep 12 14:20:58.858437 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 490/974] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:20:59.130205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:59.132499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:59.139516 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.140000 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.140433 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.141128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.141581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.142053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.173670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b16e16f-685e-44d7-b675-a6467dd76d34 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047341 Sep 12 14:20:59.174246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 485/975] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 12 14:20:59 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:59.240345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:59.241093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:59.248461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.248942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.249368 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.250057 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.250502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.250976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.275608 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:20:59.303932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:59.304552 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:59.311578 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.312068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.312524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.313251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.313678 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.314100 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.350670 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-12764038-7765-4a90-9f40-a713fed16161 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 204 len: 0 microversion: 2.20 time: 0.115308 Sep 12 14:20:59.351296 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 491/976] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 12 14:20:59 2022] DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 14:20:59.360348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:20:59.361628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:20:59.367661 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.368175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.368599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.369283 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:20:59.369728 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:20:59.370146 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:20:59.481270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:59.489547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52602c57-ca1f-4862-ae21-21f3788f6085 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.189526 Sep 12 14:20:59.490114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 486/977] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:20:59 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:20:59.529398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:59.537445 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:59.538916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:20:59.540081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-faaa9980-6e2b-4d09-b57d-b61be932a9b5 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.184323 Sep 12 14:20:59.540642 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 492/978] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:20:59 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:21:00.512645 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:00.513917 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:00.520309 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:00.520848 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:00.521284 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:00.522022 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:00.522484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:00.522932 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:00.567788 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:00.568487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:00.575334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:00.576430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:00.576869 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:00.577558 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:00.578008 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:00.578428 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:00.694234 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:00.702157 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d09ac6a-ed6d-4b72-94e0-7be6adefe400 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.193364 Sep 12 14:21:00.703094 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 487/979] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:00 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:00.740688 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:00.749318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:00.750765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:00.751963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-0e3e18a8-eba0-4e7d-8a3a-4f17346d633a tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.188514 Sep 12 14:21:00.752522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 493/980] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:00 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:21:01.724931 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:01.725543 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:01.732116 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:01.732600 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:01.733030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:01.733726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:01.734178 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:01.734601 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:01.776506 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:01.777755 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:01.784687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:01.785411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:01.785843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:01.786542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:01.787031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:01.787468 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:01.946400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:01.955338 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6060b148-338b-4400-b5d1-dbb81ad5a7ea tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.234385 Sep 12 14:21:01.955945 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 488/981] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:01 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:01.972292 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:01.980587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:01.982013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:01.983263 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1cb5509d-a8ac-43e6-a348-e26cf2bacab8 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1720 microversion: 2.20 time: 0.210752 Sep 12 14:21:01.983834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 494/982] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:01 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 14:21:02.476577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf", "name": "network-vif-deleted", "tag": "64d3ae8a-0bd3-46b1-ae67-280f451b2214"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:02.486942 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:02.487431 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:02.488469 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:02.501507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] Creating event network-vif-deleted:64d3ae8a-0bd3-46b1-ae67-280f451b2214 for instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf on hv-cinder-82002 Sep 12 14:21:02.507359 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6c2ab2fe-2942-4d4a-8fce-5cad0947f35a req-186eaad3-b5a0-46d6-b750-f7d71ada0f9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034685 Sep 12 14:21:02.508440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 489/983] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:21:02.980235 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:02.981461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:02.989591 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:02.990080 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:02.990515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:02.991257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:02.991711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:02.992131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:03.011280 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:03.013687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:03.022789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:03.023747 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:03.024427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:03.025924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:03.026620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:03.027435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:03.073569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:03.074444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:03.075423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:03.077034 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lazy-loading 'fault' on Instance uuid f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:21:03.469398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:03.483230 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:03.486258 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cafcc70e0e74a5fa7c5ce530e0e848f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701f62e5a7b14dfc86f2dcc5aa39d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:03.488321 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35d44cb9-ee84-47c5-97f2-2710af224dcc tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 200 len: 1371 microversion: 2.20 time: 0.482543 Sep 12 14:21:03.504652 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 490/984] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:03 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 1371 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 14:21:03.533811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:03.542602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6b53c54d-b7df-4dd7-9b1f-d6ca6a27c276 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.567081 Sep 12 14:21:03.543612 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 495/985] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:02 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:04.516503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:04.517664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:04.519663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:04.525798 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:04.526334 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:04.526771 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:04.527553 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:04.528283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:04.528422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:04.545201 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf HTTP/1.1 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:21:04.546787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:04.548622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf'} Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:04.549637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:04.551376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:04.553012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:04.553012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2ccb99d-4a5d-4311-9354-f4f882925009 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 404 len: 111 microversion: 2.20 time: 0.036131 Sep 12 14:21:04.553012 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 491/986] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:04 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:21:04.558110 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-57eecd20-2dff-4c00-a7c0-40d0d6c57a70 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '.version_select at 0x7f7560e2a700>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:04.569042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:04.569728 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:04.572969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:04.573897 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:04.585172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:04.586356 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:04.588198 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:04.590577 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:04.593611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-57eecd20-2dff-4c00-a7c0-40d0d6c57a70 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388239123" status: 204 len: 0 microversion: 2.20 time: 0.039646 Sep 12 14:21:04.594384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 496/987] 10.222.0.42 () {60 vars in 1262 bytes} [Mon Sep 12 14:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388239123 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 14:21:04.595483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:04.595744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:04.649646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054af95e-5fe2-49a9-a89c-261804389538", "name": "network-vif-plugged", "status": "completed", "tag": "03ad01e7-a431-482c-8631-0b48a6dc5b06"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:04.662066 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:04.662550 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:04.663004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:04.676945 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] Creating event network-vif-plugged:03ad01e7-a431-482c-8631-0b48a6dc5b06 for instance 054af95e-5fe2-49a9-a89c-261804389538 on hv-cinder-82002 Sep 12 14:21:04.682745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-2bb2eeeb-4d19-42dc-adf3-342219d8d4d7 req-bf0e3351-1d97-4bbb-b117-4fdd75f3a888 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037312 Sep 12 14:21:04.684025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 497/988] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:21:04.834983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:04.844333 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6973aa47-7442-4279-ba15-ea0c6b56faf4 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.280806 Sep 12 14:21:04.845042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 492/989] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:04 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:05.872072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:05.872982 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:05.879847 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:05.880444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:05.880936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:05.881893 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:05.882748 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:05.883630 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:06.023353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:06.031744 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-31dd7f53-1667-40f1-8a83-35ca19cd993e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1313 microversion: 2.1 time: 0.165465 Sep 12 14:21:06.032341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 498/990] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:05 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:06.555935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:06.556461 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:06.563679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:06.564165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:06.564609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:06.565315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:06.565768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:06.566192 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:06.581772 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf HTTP/1.1 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:21:06.583376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.585041 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': 'f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf'} Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:06.586952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.588994 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.590720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:06.590720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f31f1f12-4e45-48a1-b03a-fa742281c1c3 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 404 len: 111 microversion: 2.20 time: 0.033147 Sep 12 14:21:06.590720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 493/991] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 12 14:21:06 2022] DELETE /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:21:06.594389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:06.595099 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:06.601344 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:06.601843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:06.602474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:06.603310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:06.603931 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:06.604369 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:06.632805 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf HTTP/1.1 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:21:06.634512 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.636500 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': 'f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf'} Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:06.637384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. Sep 12 14:21:06.639371 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:06.641025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:06.641025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-46c73b4a-2f47-42d0-9157-1058b57fc82c tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf" status: 404 len: 111 microversion: 2.20 time: 0.050239 Sep 12 14:21:06.641025 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 499/992] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:06 2022] GET /compute/v2.1/servers/f9104fdd-bdfc-475c-b3b2-0e59ffb4a0cf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:21:07.054423 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:07.055118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:07.061637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.062120 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.062546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.063263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.063710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.064128 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.202696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:07.210585 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd720a5f-5bd3-454b-821d-e23f449266fc tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1498 microversion: 2.1 time: 0.159916 Sep 12 14:21:07.211173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 494/993] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:07 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:07.635802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:07.636381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:07.643345 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.643831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.644260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.644951 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.645402 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.646022 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.673279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:21:07.761820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f74fb81e-d5ff-4fc0-a283-57264592e038 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "DELETE /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 204 len: 0 microversion: 2.1 time: 0.130553 Sep 12 14:21:07.770576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 500/994] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:21:07 2022] DELETE /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:21:07.783417 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:07.784039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:07.806602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.806602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.806602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.806602 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.807238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.807238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.841647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:07.842244 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:07.849628 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.850257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.850703 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.851581 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.852043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.852472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.869915 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 HTTP/1.1 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:21:07.871799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.874012 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '124f260e-ab17-46a8-a63d-33ee552dbac2'} Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:07.874933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.876650 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.878085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:07.878085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cd95be38-6856-441e-92f1-00f4db4144f0 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 404 len: 111 microversion: 2.20 time: 0.044556 Sep 12 14:21:07.878085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 501/995] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 12 14:21:07 2022] DELETE /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:21:07.882465 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:07.883104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] [instance: 124f260e-ab17-46a8-a63d-33ee552dbac2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:07.889678 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.890089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.890518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.891233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:07.891687 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:07.892108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:07.906117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] HTTP exception thrown: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Request method failure captured: Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 HTTP/1.1 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz6IvHUAyMO8oHCgdZakd87voPDQefTOd2PAYyjf6CKz5xFAdJv7sZg0_NgdRTeVP46-kdHcAdGXi-IpQSnVvHjozMYGRkUeEs2XrKu7ODd-6tY2ZxpfLpw2QRUSwNVGkVqM3G-fGaNQgIVWU3GCsrVhy83ULOaExcW_3kLEgEHqbv8 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:21:07.907704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/701f62e5a7b14dfc86f2dcc5aa39d958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_701f62e5a7b14dfc86f2dcc5aa39d958", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 701f62e5a7b14dfc86f2dcc5aa39d958 Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-230938268 Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 0cafcc70e0e74a5fa7c5ce530e0e848f Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-230938268-project Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.909920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '124f260e-ab17-46a8-a63d-33ee552dbac2'} Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:07.911087 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. Sep 12 14:21:07.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:07.914618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] Returning 404 to user: Instance 124f260e-ab17-46a8-a63d-33ee552dbac2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:07.914618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e0af87ab-1138-42fb-888b-da9881291474 tempest-AttachVolumeShelveTestJSON-230938268 tempest-AttachVolumeShelveTestJSON-230938268-project] 10.222.0.42 "GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2" status: 404 len: 111 microversion: 2.20 time: 0.030353 Sep 12 14:21:07.914618 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 502/996] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 12 14:21:07 2022] GET /compute/v2.1/servers/124f260e-ab17-46a8-a63d-33ee552dbac2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 14:21:08.089374 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:08.097807 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1b36819-5937-4b1e-97bc-6378964f8222 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1504 microversion: 2.1 time: 0.325934 Sep 12 14:21:08.098460 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 495/997] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:07 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:09.121383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:09.122689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:09.130400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:09.131862 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:09.132485 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:09.133404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:09.134060 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:09.134659 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:09.461616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:09.472131 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a9f37843-1cbb-402e-9f8a-59a879c8e5e5 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1504 microversion: 2.1 time: 0.354629 Sep 12 14:21:09.473486 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 503/998] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:09 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:21:10.101229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054af95e-5fe2-49a9-a89c-261804389538", "name": "network-vif-deleted", "tag": "03ad01e7-a431-482c-8631-0b48a6dc5b06"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:10.120303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:10.123105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:10.123928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:10.144871 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] Creating event network-vif-deleted:03ad01e7-a431-482c-8631-0b48a6dc5b06 for instance 054af95e-5fe2-49a9-a89c-261804389538 on hv-cinder-82002 Sep 12 14:21:10.155666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b4408cf6-2b06-492f-af04-404224cbab56 req-13de0423-4d59-450a-a31d-bd2c4ecbee6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058350 Sep 12 14:21:10.157145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 496/999] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:21:10.498875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:10.500233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:10.508105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:10.509802 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:10.511183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:10.512426 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:10.514211 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:10.514755 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:10.553284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:10.554110 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:10.554784 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:10.555505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lazy-loading 'fault' on Instance uuid 054af95e-5fe2-49a9-a89c-261804389538 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:21:10.615885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:10.622959 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:10.630286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-fa8e51a5-1efc-49b7-bd05-e3aacabb6dff tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 200 len: 1303 microversion: 2.1 time: 0.136550 Sep 12 14:21:10.631773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 504/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:10 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:11.655243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:11.655978 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 054af95e-5fe2-49a9-a89c-261804389538] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:11.662944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:11.677630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:11.682933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:11.683755 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:11.686247 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:11.686706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:11.701345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] HTTP exception thrown: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Request method failure captured: Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 HTTP/1.1 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjH0BBuxfEv0JwJGUT19WSf40UaKjAgbZdV9hpWi05pFL9uIwpI3VTHeownh2hJOibzVly-vJL6yCq3oaNONwDhXOLMMaVEaqy78FUpLPPWNpRkPfNA7JHYEKpjSJFO00nXTFXDU8HXaHMu8twhprYlficEH9NB_NY9zGv8nqH5vUbn84 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: 7a92484ba35b46b6bd86a3072403410e Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesActionsTest-399135641 Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:21:11.705844 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a92484ba35b46b6bd86a3072403410e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesActionsTest-399135641 Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 7a92484ba35b46b6bd86a3072403410e Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesActionsTest-399135641 Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesActionsTest-399135641-project Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: 4c26b531c07a498c9617c9ee2f7bf7e9 Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesActionsTest-399135641-project Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. Sep 12 14:21:11.707275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '054af95e-5fe2-49a9-a89c-261804389538'} Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:11.708087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. Sep 12 14:21:11.709308 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:21:11.710415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Returning 404 to user: Instance 054af95e-5fe2-49a9-a89c-261804389538 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:11.710415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56034dd7-9c99-46fe-ad94-2d18f70260a9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538" status: 404 len: 111 microversion: 2.1 time: 0.054497 Sep 12 14:21:11.710415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 497/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:11 2022] GET /compute/v2.1/servers/054af95e-5fe2-49a9-a89c-261804389538 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:21:11.858163 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1429731426", "imageRef": "8d37c218-0a42-4220-b886-bb884cd21daa", "flavorRef": "452", "networks": [{"uuid": "ce8cfc23-dc23-4de7-a589-9e5ac5e263d6"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:11.920841 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] validate_networks() for [('ce8cfc23-dc23-4de7-a589-9e5ac5e263d6', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:21:12.338637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:21:12.339093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:21:12.339572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:21:12.339988 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:21:12.340400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:21:12.350183 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:12.350676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:12.351315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:12.352083 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:12.352778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:12.353470 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:12.372228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Getting quotas for project 7a92484ba35b46b6bd86a3072403410e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:21:12.376177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Getting quotas for user 4c26b531c07a498c9617c9ee2f7bf7e9 and project 7a92484ba35b46b6bd86a3072403410e. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:21:12.388584 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:21:12.391175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d37c218-0a42-4220-b886-bb884cd21daa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:21:12.440145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3d57f14a-6917-4470-b0e6-9ff33eee1977 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590563 Sep 12 14:21:12.443569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 505/1002] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:21:12.454738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-576330a2-16db-42de-b311-d39cb68b9b46 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:12.455818 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-576330a2-16db-42de-b311-d39cb68b9b46 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:12.513635 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-576330a2-16db-42de-b311-d39cb68b9b46 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:12.521409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-576330a2-16db-42de-b311-d39cb68b9b46 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1214 microversion: 2.1 time: 0.070581 Sep 12 14:21:12.522899 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 498/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:12 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:13.553646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:13.555404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:13.564961 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:13.566430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:13.567218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:13.567939 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:13.568455 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:13.568888 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:13.642719 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:13.652350 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8592f419-f729-4fad-8ef2-c61b4f08a9b2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1266 microversion: 2.1 time: 0.104005 Sep 12 14:21:13.654880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 506/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:13 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:14.680921 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:14.682270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:14.691484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:14.692375 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:14.693042 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:14.694004 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:14.694680 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:14.695381 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:14.939859 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:14.948676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-082190ad-5db8-4246-9a8d-68e21719e8d2 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.274188 Sep 12 14:21:14.949484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 499/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:14 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:15.242193 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cc240b-6cee-41af-bb68-c454291be7e2", "tag": "56539fc1-47e0-400c-80f8-6af5c4ceef8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:15.263399 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:15.264135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:15.264878 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:15.281027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] Creating event network-changed:56539fc1-47e0-400c-80f8-6af5c4ceef8a for instance 93cc240b-6cee-41af-bb68-c454291be7e2 on hv-cinder-82002 Sep 12 14:21:15.286253 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-84e72d77-2fd5-49e2-8344-8b3629eaebb0 req-35cd7142-e609-40e8-9667-8acf4ccbe2ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054837 Sep 12 14:21:15.287492 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 507/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:21:15.972676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:15.973374 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:15.979638 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:15.980129 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:15.980558 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:15.981479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:15.981933 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:15.982515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:16.138197 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:16.149538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9fef7d93-c711-4e26-bf49-bdd18bee889e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.180389 Sep 12 14:21:16.151559 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 500/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:15 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:17.174599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:17.176336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:17.191869 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:17.192382 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:17.192822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:17.193541 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:17.194004 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:17.194430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:17.354475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:17.364122 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d11888fd-dd80-48f9-a334-2f86fcb71d40 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.194166 Sep 12 14:21:17.375361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 508/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:17 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:21:18.386824 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:18.387470 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:18.393905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:18.394388 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:18.394826 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:18.395545 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:18.395995 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:18.396416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:18.535039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:18.543173 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6073539a-5294-4841-80dc-d1f648706f88 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.160041 Sep 12 14:21:18.544440 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 501/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:18 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:19.571452 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:19.572063 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:19.578444 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:19.578949 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:19.579389 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:19.580164 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:19.580615 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:19.581067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:19.713917 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:19.721740 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f7f4db9e-db3b-4260-a779-d1660b91aa77 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.154099 Sep 12 14:21:19.722305 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 509/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:19 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:20.743874 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:20.744554 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:20.754866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:20.755390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:20.756256 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:20.756987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:20.757620 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:20.758048 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:20.794206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc240b-6cee-41af-bb68-c454291be7e2", "name": "network-vif-plugged", "status": "completed", "tag": "56539fc1-47e0-400c-80f8-6af5c4ceef8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:20.806732 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:20.807384 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:20.807896 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:20.822749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] Creating event network-vif-plugged:56539fc1-47e0-400c-80f8-6af5c4ceef8a for instance 93cc240b-6cee-41af-bb68-c454291be7e2 on hv-cinder-82002 Sep 12 14:21:20.828880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-250b9380-5364-41db-a303-42e8c921ad15 req-de790ef3-a13d-459a-ba9b-306c4f92dd65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038621 Sep 12 14:21:20.830140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 510/1011] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:21:21.177584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:21.187111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7327601e-d87c-422b-89cf-8c1dd093e0dd tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1314 microversion: 2.1 time: 0.447019 Sep 12 14:21:21.187688 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 502/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:20 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:22.211091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:22.211780 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:22.218245 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:22.218729 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:22.219205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:22.219895 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:22.220348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:22.220803 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:22.349367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:22.356907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a82e4d8c-6f5d-492c-aec3-fd5b4061b4d9 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1498 microversion: 2.1 time: 0.150687 Sep 12 14:21:22.357475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 511/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:22 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:22.985897 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:22.986510 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:22.989009 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:22.994642 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:22.995154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:22.995592 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:22.996289 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:22.996787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:22.997205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:23.016527 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:23.024669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:21:23.108804 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f8400df-9362-4609-bc3c-0d609eaab4fa tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 204 len: 0 microversion: 2.1 time: 0.126449 Sep 12 14:21:23.110733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 503/1014] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:21:22 2022] DELETE /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:21:23.118493 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:23.119218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:23.122302 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:23.122953 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:23.124107 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:23.130483 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:23.131013 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:23.131443 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:23.132196 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:23.132676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:23.133247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:23.294820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:23.303144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d665828e-91bf-491f-b2bf-0c6e68a5441e tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1504 microversion: 2.1 time: 0.188315 Sep 12 14:21:23.303791 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:23 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:24.327484 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:24.328191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:24.330522 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:21:24.335656 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:24.336133 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:24.336567 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:24.337262 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:24.337711 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:24.338131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:24.471006 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:24.489096 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-463f64f2-4dc2-4460-a2a4-bcd646673609 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1504 microversion: 2.1 time: 0.163439 Sep 12 14:21:24.490385 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 504/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:24 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:25.033119 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc240b-6cee-41af-bb68-c454291be7e2", "name": "network-vif-deleted", "tag": "56539fc1-47e0-400c-80f8-6af5c4ceef8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:21:25.043051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:25.043574 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:25.044001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:25.055467 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] Creating event network-vif-deleted:56539fc1-47e0-400c-80f8-6af5c4ceef8a for instance 93cc240b-6cee-41af-bb68-c454291be7e2 on hv-cinder-82002 Sep 12 14:21:25.061323 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-7d8224ec-1e2e-4259-87a5-d504a0b8bf6e req-fc4babf0-ee79-4981-9052-8845faa3ae2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Sep 12 14:21:25.062097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 513/1017] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:21:25.516267 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:25.517036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:25.525385 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:25.525879 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:25.526319 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:25.527048 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:25.527507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:25.527934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:25.560661 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:25.561153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:25.561586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:25.562030 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lazy-loading 'fault' on Instance uuid 93cc240b-6cee-41af-bb68-c454291be7e2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:21:25.610400 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c26b531c07a498c9617c9ee2f7bf7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a92484ba35b46b6bd86a3072403410e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:21:25.618472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca54b1e7-d46c-4028-bdac-77be1b7bfa54 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 200 len: 1304 microversion: 2.1 time: 0.109365 Sep 12 14:21:25.619269 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 505/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:25 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:21:26.644784 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:21:26.645580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] [instance: 93cc240b-6cee-41af-bb68-c454291be7e2] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:21:26.652370 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:26.653404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:26.653900 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:26.654657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:21:26.655207 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:21:26.655624 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:21:26.669383 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] HTTP exception thrown: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Request method failure captured: Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 HTTP/1.1 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjH0BBuxfEv0JwJGUT19WSf40UaKjAgbZdV9hpWi05pFL9uIwpI3VTHeownh2hJOibzVly-vJL6yCq3oaNONwDhXOLMMaVEaqy78FUpLPPWNpRkPfNA7JHYEKpjSJFO00nXTFXDU8HXaHMu8twhprYlficEH9NB_NY9zGv8nqH5vUbn84 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: 7a92484ba35b46b6bd86a3072403410e Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-VolumesActionsTest-399135641 Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:21:26.671070 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a92484ba35b46b6bd86a3072403410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a92484ba35b46b6bd86a3072403410e", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-VolumesActionsTest-399135641 Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: 7a92484ba35b46b6bd86a3072403410e Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-VolumesActionsTest-399135641 Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-VolumesActionsTest-399135641-project Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 4c26b531c07a498c9617c9ee2f7bf7e9 Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-VolumesActionsTest-399135641-project Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. Sep 12 14:21:26.673072 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '93cc240b-6cee-41af-bb68-c454291be7e2'} Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:21:26.674010 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. Sep 12 14:21:26.675542 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:21:26.676724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] Returning 404 to user: Instance 93cc240b-6cee-41af-bb68-c454291be7e2 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:21:26.676724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d83b2a1c-702f-490f-940e-1e5148c2ae93 tempest-VolumesActionsTest-399135641 tempest-VolumesActionsTest-399135641-project] 10.222.0.42 "GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2" status: 404 len: 111 microversion: 2.1 time: 0.032538 Sep 12 14:21:26.676724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 514/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:21:26 2022] GET /compute/v2.1/servers/93cc240b-6cee-41af-bb68-c454291be7e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:22:06.563789 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:06.564975 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:06.566112 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:22:06.566246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Mon Sep 12 14:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 12 14:22:06.783324 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9c69666-f7ac-4af4-a71b-495e97e7bfbd tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Action: 'create', calling method: .version_select at 0x7f7560a32700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-313095960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2k6GaNY8pTkl/pckymYtkVYK5wGQQ6e4PVt9TK95Y3FRMldFgDJoRYW4rjfurPpSbEWFlPBFeWpDbgF9hi6Vx5cGp09bMgHBmCmx2caTPKSx/a9hdcmypDmEOrqN7RRw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:06.800800 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c9c69666-f7ac-4af4-a71b-495e97e7bfbd tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for project caed5793408e49edb40acad5410e02a9. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:22:06.810371 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c9c69666-f7ac-4af4-a71b-495e97e7bfbd tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for user c31fb669f8f14c8bbd5b7ec3450c930d and project caed5793408e49edb40acad5410e02a9. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:22:06.841938 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9c69666-f7ac-4af4-a71b-495e97e7bfbd tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.283195 Sep 12 14:22:06.842786 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 506/1020] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 12 14:22:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:22:28.940240 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=5 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:28.941036 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=40 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:28.945421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:28.945981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:28.952764 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:28.953241 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:28.953673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:28.954356 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:28.954807 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:28.955257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:28.977773 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.objects.instance [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lazy-loading 'flavor' on Instance uuid 71e77887-fc8a-44ab-93a3-a96e94b45687 {{(pid=120624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:22:29.047108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-880aa551-b7a5-4f63-9b16-f914e717d8a4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "POST /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687/action" status: 202 len: 0 microversion: 2.1 time: 0.108484 Sep 12 14:22:29.047741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 515/1021] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:22:28 2022] POST /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 14:22:29.056872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:29.057579 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:29.059872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:29.060708 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:29.068421 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:29.069052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:29.069566 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:29.070970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:29.071435 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:29.072093 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:29.206422 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:29.214133 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c844ed21-40e0-404f-a07b-25715d247fab tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.162019 Sep 12 14:22:29.214696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 507/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:29 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:30.239463 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:30.240144 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:30.246232 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:30.246713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:30.247168 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:30.247848 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:30.248306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:30.248725 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:30.377499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:30.385184 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-05b609c9-f110-42b6-8513-71987de9821c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.152133 Sep 12 14:22:30.385751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 516/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:30 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:31.413131 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:31.414427 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:31.421054 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:31.422103 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:31.422534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:31.423305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:31.423693 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:31.424111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:31.593922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:31.601745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb59321d-cc1f-4d79-811c-3cb9800dadca tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.197369 Sep 12 14:22:31.602551 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 508/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:31 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:22:31.672027 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-831315102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-313095960", "security_groups": [{"name": "tempest-secgroup-smoke-1346425671"}], "block_device_mapping_v2": [{"uuid": "1248a583-89e6-4cf6-a250-803bc2607647", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07c297a9-f468-46ed-8199-c258a69984ca"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:31.787831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] validate_networks() for [('07c297a9-f468-46ed-8199-c258a69984ca', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:22:32.153991 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:22:32.154447 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:22:32.154955 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:22:32.155361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:22:32.156411 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:22:32.164956 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:32.165430 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:32.165860 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:32.166576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:32.167059 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:32.167478 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:32.184746 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:22:32.188983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for user c31fb669f8f14c8bbd5b7ec3450c930d and project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:22:32.246938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:22:32.249135 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1248a583-89e6-4cf6-a250-803bc2607647',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:22:32.386174 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7fdd8b0f-c5b1-4d42-864f-f53054de4e5f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718653 Sep 12 14:22:32.386889 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 517/1025] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:22:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:22:32.398982 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-137914d6-946f-4956-b281-99e45d676220 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:32.399673 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-137914d6-946f-4956-b281-99e45d676220 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:32.456515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-137914d6-946f-4956-b281-99e45d676220 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:32.463863 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-137914d6-946f-4956-b281-99e45d676220 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1093 microversion: 2.1 time: 0.068881 Sep 12 14:22:32.464438 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 509/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:32 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:32.626751 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:32.627456 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:32.633850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:32.634341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:32.634905 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:32.635459 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:32.635918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:32.636339 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:32.799195 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:32.813510 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ea1ea77f-a5e9-447b-983d-b1951385ef0b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.191546 Sep 12 14:22:32.814497 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 518/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:32 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:33.486793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:33.487532 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:33.503856 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:33.504355 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:33.506633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:33.507719 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:33.508345 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:33.508946 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:33.584272 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:33.592508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f2ee4634-25f8-42d0-8473-930b7e16114a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1199 microversion: 2.1 time: 0.110746 Sep 12 14:22:33.593647 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 510/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:33 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1199 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:33.837472 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:33.838674 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:33.845992 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:33.846480 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:33.846951 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:33.847645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:33.848134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:33.848560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:33.983834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:33.991981 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-d04cce79-0ef5-4e9a-b235-b4873a027fc1 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.158891 Sep 12 14:22:33.992547 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 519/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:33 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:34.616776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:34.618001 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:34.625583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:34.626073 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:34.626500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:34.627500 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:34.627696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:34.628097 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:34.801180 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:34.809806 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44cc10c9-645a-4bea-a996-0fe7f5d98694 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.196978 Sep 12 14:22:34.810387 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 511/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:34 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:34.953845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80777483-7cc4-45b2-be43-d887824dc15c", "tag": "b641a3f4-7e94-40fe-870c-97d76aad7cf0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:34.963918 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:34.964653 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:34.965243 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:34.977306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] Creating event network-changed:b641a3f4-7e94-40fe-870c-97d76aad7cf0 for instance 80777483-7cc4-45b2-be43-d887824dc15c on hv-cinder-82002 Sep 12 14:22:34.982139 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-6fa790c7-cb32-49ff-940c-0927ac08b5f5 req-00b50286-3053-442c-abaf-5c7b4576650d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032138 Sep 12 14:22:34.982976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 520/1031] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:22:35.017039 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:35.017657 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:35.023613 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:35.024105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:35.024588 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:35.025251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:35.025712 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:35.026142 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:35.158366 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:35.166430 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da810361-74f6-4c0b-9275-453b3744a15b tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.153857 Sep 12 14:22:35.167036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 512/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:35 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:35.834116 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:35.835644 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:35.841261 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:35.841763 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:35.842206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:35.843570 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:35.844041 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:35.844475 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:35.994524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:36.001778 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f7826cbe-59ca-4063-adab-56bf179a96c9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.171638 Sep 12 14:22:36.002348 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 521/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:35 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:36.190581 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:36.191721 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:36.198504 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:36.199026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:36.199465 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:36.200179 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:36.200628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:36.201053 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:36.419523 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:36.427542 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26e32662-2bd4-49cc-a045-718f390778e4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.241389 Sep 12 14:22:36.428127 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 513/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:36 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:37.024524 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:37.025134 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:37.032579 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:37.033413 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:37.034037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:37.034757 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:37.035256 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:37.035683 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:37.174572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:37.182975 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-298987e6-eaa0-4f55-bd24-662fd05ed533 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.162508 Sep 12 14:22:37.183599 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 522/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:37 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:37.451557 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:37.452301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:37.458786 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:37.459286 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:37.459713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:37.460404 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:37.460855 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:37.461270 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:37.603922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:37.612286 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3567fa9-7bae-4156-b83a-1cae0b8c04f5 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.164506 Sep 12 14:22:37.612872 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 514/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:37 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:38.205810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:38.206423 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:38.212938 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:38.213416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:38.213845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:38.214518 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:38.215002 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:38.215420 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:38.343257 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:38.351460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-25f6738a-1930-44fc-bbd5-2dda13bc7ce7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.149731 Sep 12 14:22:38.352018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 523/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:38 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:38.636383 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:38.637010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:38.644332 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:38.644841 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:38.645275 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:38.645973 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:38.647726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:38.647726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:38.787713 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:38.795671 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f1222b6-901e-4179-a3e2-48c5951cae26 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.163863 Sep 12 14:22:38.796243 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 515/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:38 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:39.373587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:39.374203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:39.380636 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:39.381121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:39.381553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:39.382238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:39.382693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:39.383154 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:39.515268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:39.523660 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-562580ad-7e06-4a58-b42f-2344b8bff12d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.153873 Sep 12 14:22:39.524229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 524/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:39 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:39.819598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:39.820264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:39.826729 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:39.827231 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:39.827689 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:39.828876 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:39.829357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:39.834547 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:39.956598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:39.964252 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3049b0a-6523-4d5a-bb1f-05ce4c060ba2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.148512 Sep 12 14:22:39.964813 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:39 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:40.548401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:40.549007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:40.555405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:40.555877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:40.556310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:40.556984 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:40.557427 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:40.557843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:40.691405 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:40.699095 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a664bdd5-98c9-4a72-bbb3-f4aad181a28f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.154559 Sep 12 14:22:40.699673 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 525/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:40 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:40.987718 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:40.988295 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:40.994665 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:40.995155 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:40.995586 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:40.996268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:40.996720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:40.997140 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:41.123926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:41.132251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34feb448-af57-4302-9ad5-33059fa64b87 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.149055 Sep 12 14:22:41.132821 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 517/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:40 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:41.721809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:41.722410 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:41.728794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:41.729267 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:41.729691 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:41.730370 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:41.730812 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:41.731269 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:41.873809 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:41.881487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-3a6cd42a-8aef-41de-8ca1-82be45926e18 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.163975 Sep 12 14:22:41.882007 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 526/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:41 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:42.155015 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:42.155621 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:42.162257 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:42.162733 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:42.163191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:42.163871 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:42.164317 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:42.164732 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:42.299598 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:42.307867 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c473ad7f-6d39-406c-8a8d-553b25e73140 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.156687 Sep 12 14:22:42.308546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 518/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:42 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:42.904264 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:42.904881 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:42.907329 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:42.908050 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:42.914166 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:42.914645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:42.915108 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:42.915794 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:42.917453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:42.917453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.049001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:43.060979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-412adcac-2f0b-4272-866f-8db857b34522 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.160575 Sep 12 14:22:43.061560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 527/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:42 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:43.332664 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:43.333390 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:43.335234 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:43.341150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.341632 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.342060 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.342745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.343294 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.344353 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.476223 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:43.490633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a7a5008-4ed3-4993-8770-766ca45ba3e2 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1509 microversion: 2.1 time: 0.162418 Sep 12 14:22:43.491630 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 519/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:43 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:43.512616 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:43.513209 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:43.519696 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.520170 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.520595 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.521272 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.521713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.522128 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.557206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120624) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 14:22:43.626971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-61216d62-f34f-44dd-a2f6-5f60151e4458 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "POST /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687/action" status: 202 len: 0 microversion: 2.1 time: 0.118013 Sep 12 14:22:43.627761 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 528/1047] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 12 14:22:43 2022] POST /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:22:43.635506 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:43.636381 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:43.643021 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.643507 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.643941 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.644636 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:43.645087 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:43.645508 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:43.850092 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:43.855531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6b2ed6f6-4557-4bf8-885a-9394263dfe94 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1517 microversion: 2.1 time: 0.223413 Sep 12 14:22:43.878238 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 520/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:43 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:44.085097 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:44.085745 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:44.094528 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:44.095408 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:44.095835 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:44.097421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:44.097724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:44.098220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:44.254435 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:44.258220 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:44.263704 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-86e1b8ed-490d-44aa-8275-10ccb835669b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.183493 Sep 12 14:22:44.264280 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 529/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:44 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:44.877793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:44.878402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:44.885036 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:44.885521 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:44.885952 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:44.886641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:44.887122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:44.887546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:45.046498 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:45.054444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74058097-04d5-496e-b908-0765170054a8 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1575 microversion: 2.1 time: 0.180529 Sep 12 14:22:45.055040 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 521/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:44 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:45.286283 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:45.286944 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:45.294422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:45.294997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:45.295429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:45.296121 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:45.296573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:45.297000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:45.428106 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:45.436664 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b8a9f1fc-caf6-4ef4-8cb5-18c131e0c98e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.154334 Sep 12 14:22:45.437734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 530/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:45 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:22:45.841809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80777483-7cc4-45b2-be43-d887824dc15c", "name": "network-vif-plugged", "status": "completed", "tag": "b641a3f4-7e94-40fe-870c-97d76aad7cf0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:45.851866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:45.852357 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:45.852760 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:45.864194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] Creating event network-vif-plugged:b641a3f4-7e94-40fe-870c-97d76aad7cf0 for instance 80777483-7cc4-45b2-be43-d887824dc15c on hv-cinder-82002 Sep 12 14:22:45.869517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6b92b7d5-2b68-4954-8c5e-34bcc6dcac9e req-d10514a4-1232-44cf-bd6e-b87ae0d252a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031347 Sep 12 14:22:45.870160 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 522/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:22:46.077562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:46.078813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:46.084814 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:46.085228 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:46.085647 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:46.086328 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:46.086775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:46.087218 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:46.227301 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:46.235754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4fbef50a-464b-4351-a073-2126fdd1fb0d tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1575 microversion: 2.1 time: 0.161956 Sep 12 14:22:46.236422 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 531/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:46 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:46.460628 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:46.461329 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:46.467678 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:46.468168 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:46.468606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:46.469301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:46.469757 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:46.470183 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:46.601701 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:46.610018 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ae6904f-ff4c-4484-92ca-391f61522700 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.154096 Sep 12 14:22:46.610528 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 523/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:46 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:47.259963 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:47.261067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:47.267565 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:47.268113 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:47.268777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:47.269557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:47.270152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:47.270639 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:47.415200 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:47.422816 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-9dbbdc8d-613f-4f34-9bd6-9297fd871178 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1575 microversion: 2.1 time: 0.167259 Sep 12 14:22:47.423404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 532/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:47 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:47.632074 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:47.632716 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:47.639265 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:47.639746 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:47.640738 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:47.641428 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:47.641883 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:47.642305 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:47.813667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:47.824842 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d1e37a2-7cdb-4df0-adf5-03fb3198981c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1265 microversion: 2.1 time: 0.196577 Sep 12 14:22:47.825672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 524/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:47 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:47.893327 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "name": "network-vif-unplugged", "status": "completed", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:47.904538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:47.905781 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:47.917312 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:47.932817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] Creating event network-vif-unplugged:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:22:47.939271 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-172c2419-b236-456c-868d-96bedb9c5244 req-003d8323-04a4-44bf-bd84-701d2e0447ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050032 Sep 12 14:22:47.940043 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 533/1057] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:22:48.445394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:48.446013 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:48.451987 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:48.452476 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:48.452915 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:48.453617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:48.454076 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:48.454503 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:48.458555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:22:48.621767 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:48.630860 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-202d96a6-016e-4317-9950-b81d7dae8a63 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1575 microversion: 2.1 time: 0.189402 Sep 12 14:22:48.631483 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 525/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:48 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:48.848910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:48.849623 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:48.856260 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:48.856731 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:48.857153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:48.857850 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:48.858296 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:48.858715 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:49.003747 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:49.011800 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6429d021-93ab-46ed-9ffa-07125bda96f5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1451 microversion: 2.1 time: 0.168352 Sep 12 14:22:49.012375 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 534/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:48 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:49.034347 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:49.034990 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:49.041583 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:49.042172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:49.042687 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:49.043471 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:49.043989 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:49.044744 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:49.179499 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:49.188397 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dbd242dc-be2d-4f00-be25-d5e8650cbc63 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1451 microversion: 2.1 time: 0.157852 Sep 12 14:22:49.188970 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 526/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:49 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:49.654281 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:22:49.655273 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:22:49.662042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:49.662632 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:49.663160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:49.663858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:49.664317 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:49.664813 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:49.839972 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:22:49.848846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-5adb69f2-4fa1-46c5-bdd7-0c00d365761c tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1562 microversion: 2.1 time: 0.198582 Sep 12 14:22:49.849421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 535/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:22:49 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:22:50.031564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "name": "network-vif-plugged", "status": "completed", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:50.043130 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:50.043792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:50.044335 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:50.056666 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] Creating event network-vif-plugged:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:22:50.062748 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5aa7a279-b563-43b4-94b4-e50a59796dbd req-828a614f-1dda-4ffa-a5b7-6182c8c4e159 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Sep 12 14:22:50.063518 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 527/1062] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:22:51.017957 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80777483-7cc4-45b2-be43-d887824dc15c", "tag": "b641a3f4-7e94-40fe-870c-97d76aad7cf0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:22:51.029213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:22:51.029785 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:22:51.030284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:22:51.041846 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] Creating event network-changed:b641a3f4-7e94-40fe-870c-97d76aad7cf0 for instance 80777483-7cc4-45b2-be43-d887824dc15c on hv-cinder-82002 Sep 12 14:22:51.047029 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-48850fb3-4c21-47a2-af1c-e0908a68b98d req-de867e95-bd29-45d0-ba41-e51033dc094d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034340 Sep 12 14:22:51.047817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 536/1063] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:24:05.843707 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=44 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:05.845779 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:05.849035 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:05.850037 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=34 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:05.851007 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:05.851659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:05.855576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:24:05.859720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:05.859870 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:05.860276 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:05.861502 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:05.862091 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:05.862527 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:05.867261 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:05.867817 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:05.868255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:05.880564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] Creating event network-changed:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:24:05.886042 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-5185b0a0-9f97-4eb4-8296-dfee35a523f2 req-6faa212e-883d-487c-aa20-641e1e941727 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040854 Sep 12 14:24:05.886877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 537/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:24:05.889852 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:24:05.970726 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba602781-048e-4e37-a3ec-162ad3e9dfb7 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "DELETE /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 204 len: 0 microversion: 2.1 time: 0.128584 Sep 12 14:24:05.971369 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 528/1065] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:24:05 2022] DELETE /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:24:05.983661 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:05.984722 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:05.992716 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:05.993215 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:05.993676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:05.994346 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:05.994799 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:05.995259 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:06.265899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:06.273693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-8c9076a4-37a9-4474-aec0-fe490c1b6eba tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.295920 Sep 12 14:24:06.274265 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 538/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:05 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:07.297865 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:07.299617 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:07.306038 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:07.306530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:07.306996 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:07.307906 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:07.308360 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:07.309072 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:07.524105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:07.531834 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6ecec09-fd03-4dc5-b69a-17a7318be591 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1568 microversion: 2.1 time: 0.238155 Sep 12 14:24:07.532335 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 529/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:07 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:08.302935 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e77887-fc8a-44ab-93a3-a96e94b45687", "name": "network-vif-deleted", "tag": "eb9b598a-ecdd-4396-817a-a89e4fcfe13b"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:24:08.313118 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:08.313593 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:08.314522 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:08.326262 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] Creating event network-vif-deleted:eb9b598a-ecdd-4396-817a-a89e4fcfe13b for instance 71e77887-fc8a-44ab-93a3-a96e94b45687 on hv-cinder-82002 Sep 12 14:24:08.331537 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-c59de4de-0364-427f-b6a0-5082fd2729b2 req-2171af0a-d744-496f-9b07-a73412babd83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094454 Sep 12 14:24:08.332140 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 539/1068] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:24:08.555105 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:08.555710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:08.566211 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:08.567068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:08.567531 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:08.568233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:08.568679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:08.569132 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:08.644751 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956fadcbd1e4bcd853eaf7cd5115d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a527e5cc441f5901536b58d4fe400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:08.653505 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f27e9c1-5260-4fca-9dd1-ecf74f1edea4 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 200 len: 1218 microversion: 2.1 time: 0.102163 Sep 12 14:24:08.654104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 530/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:08 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:09.675271 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:24:09.675836 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Mon Sep 12 14:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 (ip 10.222.0.42) !!! Sep 12 14:24:09.680646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:09.681372 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] [instance: 71e77887-fc8a-44ab-93a3-a96e94b45687] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:09.688940 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:09.689416 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:09.689845 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:09.690532 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:09.691019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:09.691438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:09.705718 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] HTTP exception thrown: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Request method failure captured: Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 HTTP/1.1 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjHz_hVEwlZanml0yruJlfgtKktO6KVO22VEAw254h4tQt3QHuUiUYdU1GEvijlcWj8yU9AkVuDTNogAE4MVEi6fO6vD0pVxN24kxKJsouJssxjdfNtneAi-ZFxjjVMdTeHKC_mpum030PhA2sGwKjhYfKW33Uk7T3r-pUoYWG67gSCuI Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: fd4a527e5cc441f5901536b58d4fe400 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestShelveInstance-983927421 Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:24:09.707353 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fd4a527e5cc441f5901536b58d4fe400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fd4a527e5cc441f5901536b58d4fe400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fd4a527e5cc441f5901536b58d4fe400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fd4a527e5cc441f5901536b58d4fe400", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestShelveInstance-983927421 Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: fd4a527e5cc441f5901536b58d4fe400 Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestShelveInstance-983927421 Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-TestShelveInstance-983927421-project Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: 0956fadcbd1e4bcd853eaf7cd5115d93 Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestShelveInstance-983927421-project Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. Sep 12 14:24:09.709177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '71e77887-fc8a-44ab-93a3-a96e94b45687'} Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:24:09.710206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. Sep 12 14:24:09.711880 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:24:09.713324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Returning 404 to user: Instance 71e77887-fc8a-44ab-93a3-a96e94b45687 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:24:09.713324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-cc1b02ab-2204-40c2-b966-a39eced4edff tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687" status: 404 len: 111 microversion: 2.1 time: 0.035076 Sep 12 14:24:09.713324 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 540/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:09 2022] GET /compute/v2.1/servers/71e77887-fc8a-44ab-93a3-a96e94b45687 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:24:09.865055 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9572372-9c1a-44a3-b9ff-16ade5622543 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] Calling method '.version_select at 0x7f7560cbe8b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:09.890511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9572372-9c1a-44a3-b9ff-16ade5622543 tempest-TestShelveInstance-983927421 tempest-TestShelveInstance-983927421-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305137904" status: 202 len: 0 microversion: 2.1 time: 0.029749 Sep 12 14:24:09.891044 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 531/1071] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 12 14:24:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305137904 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 14:24:48.423983 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:48.424557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:48.426572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=8 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:48.427233 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=12 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:48.433398 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:48.433872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:48.434300 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:48.435005 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:48.435453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:48.435869 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:48.462821 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Going to try to terminate instance {{(pid=120624) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:24:48.536261 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a812a177-f21b-4b90-9cfa-62a414d207b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 204 len: 0 microversion: 2.1 time: 0.116555 Sep 12 14:24:48.536837 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 541/1072] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:24:48 2022] DELETE /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:24:48.542969 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:48.543788 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:24:48.549534 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:48.550394 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:48.559303 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:48.559792 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:48.560233 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:48.560930 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:48.561389 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:48.561819 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:48.697606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:48.706052 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d66bd2e-60ac-4fa6-b996-868ca3fe8ef4 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1576 microversion: 2.1 time: 0.165046 Sep 12 14:24:48.706609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 532/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:48 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:24:49.729295 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:49.729994 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:49.737091 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:49.737568 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:49.737997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:49.738675 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:49.739159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:49.739580 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:49.873202 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:49.880969 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e08b2256-ee4d-47e9-a7ff-a963cccdcbaf tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1576 microversion: 2.1 time: 0.155899 Sep 12 14:24:49.881531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 542/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:49 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:50.904895 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:50.905515 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:50.912574 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:50.913057 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:50.913490 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:50.914181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:50.914663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:50.915144 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:50.976104 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:50.983833 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1656e51-2a4e-4e1f-b07e-b6aa95146bb5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 200 len: 1508 microversion: 2.1 time: 0.082834 Sep 12 14:24:50.984420 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 533/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:50 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 1508 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:51.056705 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80777483-7cc4-45b2-be43-d887824dc15c", "name": "network-vif-deleted", "tag": "b641a3f4-7e94-40fe-870c-97d76aad7cf0"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:24:51.067750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:51.068229 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:51.068657 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:51.080849 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] Creating event network-vif-deleted:b641a3f4-7e94-40fe-870c-97d76aad7cf0 for instance 80777483-7cc4-45b2-be43-d887824dc15c on hv-cinder-82002 Sep 12 14:24:51.085738 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-3fc87235-c8e4-465e-bd95-ab4500c5c466 req-1bd69576-49d3-45bc-94d0-e96f1ffb43da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Sep 12 14:24:51.086377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 543/1076] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:24:52.006050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:52.006805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:52.013161 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:52.013641 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:52.014071 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:52.014756 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:52.015236 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:52.015659 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:52.033909 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] HTTP exception thrown: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Request method failure captured: Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c HTTP/1.1 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjH0CJ4sTsidLqb2PYyOygujH-LKHy2w496wcJHkEudmbcgzp5q6nVEbWh7ELvVbpeqT_75YhDRkZEynMFk7TZ3mjY69kqyA9YdizV0vxHn9aL12RdGGDcFo-eOf5d8lFgmv7Vj9sIpLAUaJljC4i4GxThVFKilQpOcJHAVlKhnmwcqFA Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:24:52.035599 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/caed5793408e49edb40acad5410e02a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_caed5793408e49edb40acad5410e02a9", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: c31fb669f8f14c8bbd5b7ec3450c930d Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:24:52.037191 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '80777483-7cc4-45b2-be43-d887824dc15c'} Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:24:52.038107 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:24:52.039537 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:24:52.040827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Returning 404 to user: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:24:52.040827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3985db9c-c4a3-4403-841a-40e4166e42ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 404 len: 111 microversion: 2.1 time: 0.034842 Sep 12 14:24:52.040827 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 534/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:52 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:24:52.136709 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-12603539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-313095960", "security_groups": [{"name": "tempest-secgroup-smoke-1346425671"}], "block_device_mapping_v2": [{"uuid": "1248a583-89e6-4cf6-a250-803bc2607647", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07c297a9-f468-46ed-8199-c258a69984ca"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:24:52.257999 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] validate_networks() for [('07c297a9-f468-46ed-8199-c258a69984ca', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:24:52.621365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:24:52.621777 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:24:52.622238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:24:52.622637 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:24:52.623077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:24:52.632152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:52.632625 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:52.633051 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:52.633758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:52.634205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:52.634621 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:52.651282 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:24:52.655176 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for user c31fb669f8f14c8bbd5b7ec3450c930d and project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:24:52.712093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:24:52.714286 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1248a583-89e6-4cf6-a250-803bc2607647',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:24:52.845698 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7afc9fec-4ca6-4bb4-92e6-e4b1b1f3ad5e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713835 Sep 12 14:24:52.846502 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 544/1078] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:24:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:24:52.857643 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a346876-af3a-45a1-8505-7c104c46dc53 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:52.858253 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a346876-af3a-45a1-8505-7c104c46dc53 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:52.910369 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a346876-af3a-45a1-8505-7c104c46dc53 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:52.917363 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a346876-af3a-45a1-8505-7c104c46dc53 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1092 microversion: 2.1 time: 0.063648 Sep 12 14:24:52.917926 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 535/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:52 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:53.940693 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-4d91562e-1b91-491c-aab6-d34e26b96e2b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:53.941306 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-4d91562e-1b91-491c-aab6-d34e26b96e2b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:53.991839 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-4d91562e-1b91-491c-aab6-d34e26b96e2b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:53.998735 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-4d91562e-1b91-491c-aab6-d34e26b96e2b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1092 microversion: 2.1 time: 0.062875 Sep 12 14:24:53.999330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 545/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:53 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1092 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:55.022154 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:55.022761 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:55.029449 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:55.029925 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:55.030352 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:55.031061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:55.031511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:55.031928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:55.093679 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:55.101264 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9627f1e2-c544-4500-9d4a-1b558dfa6ea1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1142 microversion: 2.1 time: 0.083719 Sep 12 14:24:55.101820 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 536/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:55 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:56.123534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:56.124172 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:56.132063 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:56.132544 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:56.133222 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:56.133916 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:56.134364 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:56.135019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:56.198209 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:56.207741 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-a4cd1a00-f6dc-4e4f-ab1b-fb1325560f9c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1208 microversion: 2.1 time: 0.087960 Sep 12 14:24:56.219114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 546/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:56 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:57.231205 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:57.231949 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:57.239011 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:57.239497 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:57.239936 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:57.240634 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:57.241090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:57.241520 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:57.373944 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:57.382416 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f41e5a1f-d47a-4a29-b3b4-46a11741bf3d tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.155713 Sep 12 14:24:57.383315 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 537/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:57 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:57.395804 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e641aa-6e6d-432b-b2fa-70cc175d3028", "tag": "6cdb7cba-691e-4ca9-ac87-f6ddec0b6562"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:24:57.410531 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:57.411337 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:57.411775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:57.423104 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] Creating event network-changed:6cdb7cba-691e-4ca9-ac87-f6ddec0b6562 for instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 on hv-cinder-82002 Sep 12 14:24:57.428394 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-8953c2b5-1888-44e3-a383-1d9407fb8cba req-05c1eb70-5ce5-44f4-b7e5-9b687994e6ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048429 Sep 12 14:24:57.429159 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 547/1084] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:24:58.409983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:58.410676 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:58.417106 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:58.417580 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:58.418010 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:58.418695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:58.419178 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:58.419593 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:58.549889 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:58.557486 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5cc184a-4489-4b40-912a-829dec034c6e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.151884 Sep 12 14:24:58.558316 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 538/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:58 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:24:59.581126 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:24:59.581843 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:24:59.588081 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:59.588560 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:59.588987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:59.589667 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:24:59.590112 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:24:59.590555 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:24:59.718885 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:24:59.727255 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-dba1821b-2cd7-49c6-9440-395e5600785f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.150826 Sep 12 14:24:59.727820 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 548/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:24:59 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:00.749517 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:00.750126 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:00.756555 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:00.757025 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:00.757466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:00.758125 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:00.758572 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:00.759022 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:00.896730 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:00.904314 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55c0a8ee-fc75-484c-b142-e9a7e3911049 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.158693 Sep 12 14:25:00.904878 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 539/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:00 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:01.927031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:01.927638 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:01.934279 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:01.934749 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:01.935200 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:01.935872 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:01.936318 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:01.936732 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:02.066772 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:02.074451 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-ca04f914-191c-4e22-ac4d-314382a5a47c tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.151390 Sep 12 14:25:02.075028 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 549/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:01 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:03.098290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:03.098809 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:03.101143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:03.106610 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:03.107115 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:03.107546 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:03.108241 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:03.108867 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:03.109288 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:03.235983 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:03.244290 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdebb764-c92e-4de3-8681-39d8ff85d110 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.150380 Sep 12 14:25:03.244866 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 540/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:03 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:04.268736 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:04.269352 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:04.271361 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:04.272471 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=8 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:25:04.278381 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:04.278878 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:04.279315 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:04.279997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:04.280446 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:04.280863 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:04.412385 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:04.420167 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-b1ddeab4-88a0-43d8-a3a9-abf4dcd042ba tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.155287 Sep 12 14:25:04.420739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 550/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:04 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:05.443725 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:05.444367 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:05.450750 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:05.451263 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:05.451695 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:05.452379 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:05.452829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:05.453251 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:05.582479 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:05.590153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e178948-d8f6-4158-9827-f43dd312bc04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.150289 Sep 12 14:25:05.590722 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 541/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:05 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:06.613571 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:06.614283 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:06.621066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:06.621564 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:06.621998 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:06.622935 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:06.623402 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:06.623838 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:06.738246 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e641aa-6e6d-432b-b2fa-70cc175d3028", "name": "network-vif-plugged", "status": "completed", "tag": "6cdb7cba-691e-4ca9-ac87-f6ddec0b6562"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:25:06.747496 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:06.747976 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:06.748397 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:06.759378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] Creating event network-vif-plugged:6cdb7cba-691e-4ca9-ac87-f6ddec0b6562 for instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 on hv-cinder-82002 Sep 12 14:25:06.764562 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-45df1a9c-0f80-4ff2-9347-f57fac11df55 req-718e131d-34fe-4d93-8936-a6abbbb98c66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164917 Sep 12 14:25:06.765152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 551/1092] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:25:06.765524 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:06.773413 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02ff5132-b1e2-4656-ab2e-7afeb3eb0774 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.164235 Sep 12 14:25:06.773980 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 542/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:06 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:07.798133 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:07.799367 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:07.805694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:07.806175 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:07.806600 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:07.807303 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:07.807750 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:07.808418 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:07.934928 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:07.943085 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-72a244fe-1790-4388-986b-b72cca13d453 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1264 microversion: 2.1 time: 0.149557 Sep 12 14:25:07.943646 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 552/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:07 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:08.965495 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:08.966111 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:08.973313 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:08.973795 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:08.974229 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:08.974947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:08.975405 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:08.975829 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:09.104737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:09.112962 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb9b5051-a998-429a-b66d-239041d5c784 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1451 microversion: 2.1 time: 0.151297 Sep 12 14:25:09.113530 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 543/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:08 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:09.134515 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:25:09.135261 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:25:09.141831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:09.142310 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:09.142724 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:09.143424 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:09.143867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:09.144280 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:09.271038 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:25:09.278711 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-73299dcd-465a-4657-92c3-f7913f201181 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1451 microversion: 2.1 time: 0.147976 Sep 12 14:25:09.279298 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 553/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:25:09 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:25:11.070451 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e641aa-6e6d-432b-b2fa-70cc175d3028", "tag": "6cdb7cba-691e-4ca9-ac87-f6ddec0b6562"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:25:11.080737 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:25:11.081143 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:25:11.081569 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:25:11.094706 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] Creating event network-changed:6cdb7cba-691e-4ca9-ac87-f6ddec0b6562 for instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 on hv-cinder-82002 Sep 12 14:25:11.100538 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c09c3174-4ea3-4c78-a117-b68999387be0 req-101ccaa6-ab02-44d9-bd88-b4f2d8b05235 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Sep 12 14:25:11.101118 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 544/1097] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:26:45.146948 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:45.147686 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:45.152611 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1895316390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-313095960", "security_groups": [{"name": "tempest-secgroup-smoke-1346425671"}], "block_device_mapping_v2": [{"uuid": "c03883ce-bdee-482a-94d7-9000f51d4fb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07c297a9-f468-46ed-8199-c258a69984ca"}]}} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:26:45.266622 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.network.neutron [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] validate_networks() for [('07c297a9-f468-46ed-8199-c258a69984ca', None, None, None, None, None)] {{(pid=120624) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 14:26:45.715477 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 14:26:45.715906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image limits 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 14:26:45.716377 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Flavor pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 14:26:45.716811 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Image pref 0:0:0 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 14:26:45.717758 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.virt.hardware [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 14:26:45.726386 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:45.726886 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:45.727321 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:45.728035 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:45.728487 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:45.728907 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:45.745754 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 14:26:45.749689 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.quota [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Getting quotas for user c31fb669f8f14c8bbd5b7ec3450c930d and project caed5793408e49edb40acad5410e02a9. Resources: {'cores', 'instances', 'ram'} {{(pid=120624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 14:26:45.805438 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Going to run 1 instances... {{(pid=120624) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 14:26:45.807828 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c03883ce-bdee-482a-94d7-9000f51d4fb5',volume_size=None,volume_type=None)] {{(pid=120624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 14:26:45.935933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-7c7aad8d-a265-4654-94a7-ae2c8cef14ca tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790702 Sep 12 14:26:45.936572 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 554/1098] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 12 14:26:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 14:26:45.946446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:45.947278 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=64 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:45.948172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:26:45.948318 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Mon Sep 12 14:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 (ip 10.222.0.42) !!! Sep 12 14:26:45.956348 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3058b5f7-988c-4cbe-9af5-b2da55aed857 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:45.957047 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3058b5f7-988c-4cbe-9af5-b2da55aed857 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:46.012286 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3058b5f7-988c-4cbe-9af5-b2da55aed857 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:46.019851 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3058b5f7-988c-4cbe-9af5-b2da55aed857 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1094 microversion: 2.1 time: 0.075973 Sep 12 14:26:46.020415 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 545/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:45 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:47.043049 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:47.043676 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:47.050390 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:47.050906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:47.051548 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:47.052057 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:47.052602 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:47.052906 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:47.121388 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:47.129694 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-c1f0ffa6-45f7-4e35-8ec2-98d723ff69e5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1210 microversion: 2.1 time: 0.091007 Sep 12 14:26:47.130266 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 555/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:47 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:26:48.152457 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:48.153377 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:48.162152 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:48.163068 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:48.163918 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:48.164910 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:48.165376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:48.165805 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:48.293934 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:48.302090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ee56496-2243-4ad1-9c54-9ecf56c07a9f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.153579 Sep 12 14:26:48.302671 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 546/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:48 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:48.353858 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36321844-2dcf-4c9b-9b01-bfc28441b341", "tag": "692746c2-625c-4d04-b094-fc90beaaaa8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:26:48.364606 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:48.365093 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:48.365533 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:48.377379 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] Creating event network-changed:692746c2-625c-4d04-b094-fc90beaaaa8a for instance 36321844-2dcf-4c9b-9b01-bfc28441b341 on hv-cinder-82002 Sep 12 14:26:48.382247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d96ac5db-5732-4ff2-a892-61cadaf804eb req-99e7a52a-a2cc-4af3-b267-415f543559e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Sep 12 14:26:48.383739 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 556/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:26:49.325587 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:49.326197 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:49.332696 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:49.333181 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:49.333615 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:49.334299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:49.334745 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:49.335188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:49.468831 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:49.476535 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0645f25-5f16-4ad3-bce4-0fcfe480bc79 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.154830 Sep 12 14:26:49.477114 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 547/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:49 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:50.500732 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:50.501453 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:50.508021 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:50.508495 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:50.508920 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:50.509596 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:50.510044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:50.510458 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:50.640101 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:50.647775 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-adc7f872-0779-46ee-9fa1-722d6103f0b7 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.151842 Sep 12 14:26:50.648341 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 557/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:50 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:51.669442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:51.670709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:51.677177 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:51.677663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:51.678090 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:51.678776 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:51.679259 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:51.679682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:51.806529 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:51.814442 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14e7a271-f608-4082-ba99-3081456e4d94 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.148873 Sep 12 14:26:51.815032 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 548/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:51 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:52.835928 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:52.836395 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:52.843460 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:52.843932 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:52.844373 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:52.845031 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:52.845474 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:52.845890 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:52.975112 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:52.982723 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-6629ef0b-5006-4528-b0e8-aad8d732c467 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.150769 Sep 12 14:26:52.983302 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 558/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:52 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:54.005123 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:54.005732 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:54.012122 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:54.012597 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:54.013026 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:54.014320 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:54.014768 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:54.015210 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:54.141905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:54.149436 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d961612a-07b9-496a-bd35-ee3fac2aedb9 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.148229 Sep 12 14:26:54.149999 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 549/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:54 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:55.170942 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:55.171587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:55.177987 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:55.178469 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:55.178933 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:55.179627 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:55.180084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:55.180508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:55.311203 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:55.318910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-36137d07-7c5b-40b1-97fe-4c5f8d55049f tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.151846 Sep 12 14:26:55.319479 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 559/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:55 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:56.341808 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:56.342426 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:56.344336 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:56.349663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:56.350145 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:56.350609 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:56.351322 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:56.351774 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:56.352194 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:56.480147 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:56.487959 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-caef7a1b-afa7-4014-b34e-92c79631e0e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.150277 Sep 12 14:26:56.488468 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 550/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:56 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:57.116588 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36321844-2dcf-4c9b-9b01-bfc28441b341", "name": "network-vif-plugged", "status": "completed", "tag": "692746c2-625c-4d04-b094-fc90beaaaa8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:26:57.121526 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=2 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:57.122194 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell0:SELECT=6 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:26:57.128857 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:57.129336 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:57.129765 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:57.141538 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] Creating event network-vif-plugged:692746c2-625c-4d04-b094-fc90beaaaa8a for instance 36321844-2dcf-4c9b-9b01-bfc28441b341 on hv-cinder-82002 Sep 12 14:26:57.146569 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-ded7393e-d009-413b-92ed-f968d6ec709e req-5bc38973-a7e9-4642-a50a-3a5d7252c41d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033737 Sep 12 14:26:57.147206 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 560/1110] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:26:57.510691 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:57.511330 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:57.517670 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:57.518150 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:57.518584 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:57.519301 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:57.519754 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:57.520172 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:57.648268 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:57.656488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fff934e-a86f-4ea2-89da-1f8633fd14a1 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1266 microversion: 2.1 time: 0.149652 Sep 12 14:26:57.657050 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 551/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:57 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:58.680400 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:58.681001 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:58.687401 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:58.687875 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:58.688297 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:58.688971 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:58.689417 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:58.689834 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:58.821947 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:58.830268 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-44376094-3db3-4f5c-b165-0d4622516e7a tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1452 microversion: 2.1 time: 0.154596 Sep 12 14:26:58.830830 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 561/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:58 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:26:58.852633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:26:58.853250 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:26:58.859709 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:58.860190 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:58.860653 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:58.861340 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:26:58.861793 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:26:58.862212 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:26:58.989992 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:26:58.997682 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77c933c2-04db-4087-909b-30b9297248eb tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1452 microversion: 2.1 time: 0.148966 Sep 12 14:26:58.998285 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 552/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:26:58 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:27:00.594734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36321844-2dcf-4c9b-9b01-bfc28441b341", "tag": "692746c2-625c-4d04-b094-fc90beaaaa8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:27:00.604153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:27:00.604822 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:27:00.605530 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:27:00.616525 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] Creating event network-changed:692746c2-625c-4d04-b094-fc90beaaaa8a for instance 36321844-2dcf-4c9b-9b01-bfc28441b341 on hv-cinder-82002 Sep 12 14:27:00.621505 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-d9a88dd4-fb42-46f4-b15d-c6cd70f06a76 req-417bcfa9-58de-4a6f-ac0c-980c3c9c49c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089977 Sep 12 14:27:00.622117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 562/1114] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:28:29.690822 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:28:29.691651 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=42 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:28:29.692778 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:28:29.692924 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Mon Sep 12 14:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 (ip 10.222.0.42) !!! Sep 12 14:28:29.694376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:28:29.694519 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Mon Sep 12 14:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 (ip 10.222.0.42) !!! Sep 12 14:28:29.698787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:29.699974 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36321844-2dcf-4c9b-9b01-bfc28441b341", "tag": "692746c2-625c-4d04-b094-fc90beaaaa8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:28:29.700432 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:29.709979 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:29.710961 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:29.711399 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:29.712092 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:29.712540 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:29.712955 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:29.718421 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afdd219e-aa7c-492a-85fd-90ccbcf27466] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 12 14:28:29.719089 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:28:29.719829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG dbcounter [-] [120624] Writing DB stats nova_cell1:SELECT=38 {{(pid=120624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 14:28:29.721213 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 12 14:28:29.721706 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Mon Sep 12 14:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 12 14:28:29.725511 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:29.726231 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:29.726734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:29.742727 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:28:29.749564 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] Creating event network-changed:692746c2-625c-4d04-b094-fc90beaaaa8a for instance 36321844-2dcf-4c9b-9b01-bfc28441b341 on hv-cinder-82002 Sep 12 14:28:29.755499 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-20e15c96-25e7-438f-8f29-7437cbe39e76 req-2a4ded66-2631-4fa3-94b6-57abe6d304bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064631 Sep 12 14:28:29.756550 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 563/1115] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 14:28:29.832222 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0be88262-808a-495f-b533-73f45d079626 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "DELETE /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 204 len: 0 microversion: 2.1 time: 0.142496 Sep 12 14:28:29.832474 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 553/1116] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:28:29 2022] DELETE /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:28:29.842127 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:29.842829 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:29.853624 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:29.854114 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:29.854546 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:29.855289 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:29.855734 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:29.856867 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:29.995534 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:30.003576 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-f363d51e-fa24-4a33-9821-2571a6cb574e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1576 microversion: 2.1 time: 0.166469 Sep 12 14:28:30.004155 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 564/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:29 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:28:31.027488 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:31.028199 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:31.035637 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:31.036277 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:31.036717 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:31.037419 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:31.037877 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:31.038304 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:31.170947 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:31.178622 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41e894ca-5bed-4f37-a262-91d17381606b tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1576 microversion: 2.1 time: 0.155434 Sep 12 14:28:31.179224 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 554/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:31 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:28:32.090018 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36321844-2dcf-4c9b-9b01-bfc28441b341", "name": "network-vif-deleted", "tag": "692746c2-625c-4d04-b094-fc90beaaaa8a"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:28:32.101441 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:32.101910 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:32.102334 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:32.114077 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] Creating event network-vif-deleted:692746c2-625c-4d04-b094-fc90beaaaa8a for instance 36321844-2dcf-4c9b-9b01-bfc28441b341 on hv-cinder-82002 Sep 12 14:28:32.119044 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-8ee3e9b3-8b84-47ea-af3b-c96593a6b60e req-ca9a51e3-97ed-4d51-b871-6ee6d7198713 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Sep 12 14:28:32.119645 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 565/1119] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:28:32.203061 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:32.203669 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:32.210246 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:32.210720 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:32.211169 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:32.211849 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:32.212297 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:32.212710 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:32.272658 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:32.280204 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d72a2ebf-13f4-41be-abd7-d56586e8c315 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 200 len: 1225 microversion: 2.1 time: 0.081631 Sep 12 14:28:32.280763 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 555/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:32 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:28:33.300120 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO oslo.messaging._drivers.impl_rabbit [-] [afdd219e-aa7c-492a-85fd-90ccbcf27466] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 52162. Sep 12 14:28:33.304105 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:33.304796 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 36321844-2dcf-4c9b-9b01-bfc28441b341] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:33.311404 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:33.311877 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:33.312304 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:33.313014 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:33.313466 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:33.313884 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:33.327556 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] HTTP exception thrown: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Request method failure captured: Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 HTTP/1.1 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjH0CJ4sTsidLqb2PYyOygujH-LKHy2w496wcJHkEudmbcgzp5q6nVEbWh7ELvVbpeqT_75YhDRkZEynMFk7TZ3mjY69kqyA9YdizV0vxHn9aL12RdGGDcFo-eOf5d8lFgmv7Vj9sIpLAUaJljC4i4GxThVFKilQpOcJHAVlKhnmwcqFA Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:28:33.329153 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/caed5793408e49edb40acad5410e02a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_caed5793408e49edb40acad5410e02a9", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: c31fb669f8f14c8bbd5b7ec3450c930d Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. Sep 12 14:28:33.331000 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '36321844-2dcf-4c9b-9b01-bfc28441b341'} Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:28:33.331899 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. Sep 12 14:28:33.333378 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:33.334831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Returning 404 to user: Instance 36321844-2dcf-4c9b-9b01-bfc28441b341 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:28:33.334831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-1b583fa9-ee31-4251-978f-ba1f98b7b26e tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341" status: 404 len: 111 microversion: 2.1 time: 0.031635 Sep 12 14:28:33.334831 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 566/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:33 2022] GET /compute/v2.1/servers/36321844-2dcf-4c9b-9b01-bfc28441b341 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:28:36.373875 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:36.379152 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e641aa-6e6d-432b-b2fa-70cc175d3028", "tag": "6cdb7cba-691e-4ca9-ac87-f6ddec0b6562"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:28:36.385376 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:36.392713 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:36.392902 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:36.393206 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:36.393326 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:36.393649 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:36.393766 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:36.394472 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:36.394957 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:36.395386 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:36.406236 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] Creating event network-changed:6cdb7cba-691e-4ca9-ac87-f6ddec0b6562 for instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 on hv-cinder-82002 Sep 12 14:28:36.411205 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-fd1da56d-ebfb-41da-b4d3-05c8ced054c2 req-9f48a301-9158-46ee-b562-cd0c960969ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Sep 12 14:28:36.412137 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 567/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:28:36.424787 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 14:28:36.504022 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f607e6ab-12cd-47d3-b586-1db1d4b75c04 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 204 len: 0 microversion: 2.1 time: 0.133777 Sep 12 14:28:36.504511 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 556/1123] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:28:36 2022] DELETE /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 14:28:36.515979 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:36.517094 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:36.524247 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:36.524997 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:36.525573 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:36.526365 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:36.527019 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:36.527491 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:36.695067 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.policy [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120624) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:36.703557 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-795611d3-33a9-493c-8dad-eded2c5112c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1575 microversion: 2.1 time: 0.193907 Sep 12 14:28:36.704237 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 568/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:36 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 14:28:37.727193 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:37.727922 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:37.734398 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:37.734905 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:37.735341 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:37.736029 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:37.736487 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:37.736937 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:37.907928 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:37.915633 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f795848-059b-4783-9179-65786889e916 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1575 microversion: 2.1 time: 0.192730 Sep 12 14:28:37.916444 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 557/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:37 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:28:38.648008 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e641aa-6e6d-432b-b2fa-70cc175d3028", "name": "network-vif-deleted", "tag": "6cdb7cba-691e-4ca9-ac87-f6ddec0b6562"}]} {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 14:28:38.659160 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:38.659631 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:38.660052 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:38.673117 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.compute.server_external_events [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] Creating event network-vif-deleted:6cdb7cba-691e-4ca9-ac87-f6ddec0b6562 for instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 on hv-cinder-82002 Sep 12 14:28:38.680177 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [req-8f90aba5-eef4-4dbb-b1d8-927490f1889e req-302f0f6a-f944-4ef9-b87a-7f9fa9796d42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Sep 12 14:28:38.685075 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 569/1126] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 12 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 14:28:38.939777 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:38.940409 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:38.947672 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:38.948165 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:38.948663 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:38.949296 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:38.949843 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:38.950153 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:38.986864 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:38.987358 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:38.987899 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:38.988446 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lazy-loading 'fault' on Instance uuid 69e641aa-6e6d-432b-b2fa-70cc175d3028 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 14:28:39.036234 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31fb669f8f14c8bbd5b7ec3450c930d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed5793408e49edb40acad5410e02a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 14:28:39.045323 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c260b19-a560-4793-8e6d-c66238d7b446 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 200 len: 1228 microversion: 2.1 time: 0.109692 Sep 12 14:28:39.046058 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 558/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:38 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 1228 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 14:28:40.069553 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:40.070238 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 69e641aa-6e6d-432b-b2fa-70cc175d3028] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:40.076936 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.077407 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.077832 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.078508 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.078985 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.079406 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.093045 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] HTTP exception thrown: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Request method failure captured: Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 HTTP/1.1 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjH0CJ4sTsidLqb2PYyOygujH-LKHy2w496wcJHkEudmbcgzp5q6nVEbWh7ELvVbpeqT_75YhDRkZEynMFk7TZ3mjY69kqyA9YdizV0vxHn9aL12RdGGDcFo-eOf5d8lFgmv7Vj9sIpLAUaJljC4i4GxThVFKilQpOcJHAVlKhnmwcqFA Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:28:40.094575 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/caed5793408e49edb40acad5410e02a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_caed5793408e49edb40acad5410e02a9", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: c31fb669f8f14c8bbd5b7ec3450c930d Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. Sep 12 14:28:40.096429 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '69e641aa-6e6d-432b-b2fa-70cc175d3028'} Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:28:40.097330 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. Sep 12 14:28:40.098756 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.100227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Returning 404 to user: Instance 69e641aa-6e6d-432b-b2fa-70cc175d3028 could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:28:40.100227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-e8ea3f87-6e85-4b0f-9caf-12a2a1cbc3e3 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028" status: 404 len: 111 microversion: 2.1 time: 0.031197 Sep 12 14:28:40.100227 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 570/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:40 2022] GET /compute/v2.1/servers/69e641aa-6e6d-432b-b2fa-70cc175d3028 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:28:40.779193 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:40.779705 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:40.786136 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.786606 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.787066 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.787742 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.788188 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.788603 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.802102 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] HTTP exception thrown: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Request method failure captured: Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c HTTP/1.1 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Connection: close Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Host: 10.222.0.42 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjH0CJ4sTsidLqb2PYyOygujH-LKHy2w496wcJHkEudmbcgzp5q6nVEbWh7ELvVbpeqT_75YhDRkZEynMFk7TZ3mjY69kqyA9YdizV0vxHn9aL12RdGGDcFo-eOf5d8lFgmv7Vj9sIpLAUaJljC4i4GxThVFKilQpOcJHAVlKhnmwcqFA Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 12 14:28:40.803690 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/caed5793408e49edb40acad5410e02a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_caed5793408e49edb40acad5410e02a9", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Id: c31fb669f8f14c8bbd5b7ec3450c930d Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: method: > Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: exception: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.805391 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: action_args: {'id': '80777483-7cc4-45b2-be43-d887824dc15c'} Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:28:40.806667 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.808299 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.810466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Returning 404 to user: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:28:40.810466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-783e67ed-ad1c-4696-bfdc-3527009bf566 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 404 len: 111 microversion: 2.1 time: 0.029862 Sep 12 14:28:40.810466 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 559/1129] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 12 14:28:40 2022] DELETE /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:28:40.814322 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '>' {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:40.814954 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.compute.api [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] [instance: 80777483-7cc4-45b2-be43-d887824dc15c] Fetching instance by UUID {{(pid=120624) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 14:28:40.820810 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.821284 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.821708 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.822387 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Acquiring lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 14:28:40.822874 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 14:28:40.823293 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG oslo_concurrency.lockutils [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Lock "294b7baa-bea0-4a69-9ea0-7bb098aa05ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 14:28:40.836587 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.wsgi [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] HTTP exception thrown: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Request method failure captured: Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: request: GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c HTTP/1.1 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept: application/json Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Accept-Encoding: identity Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Connection: close Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Length: 0 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Content-Type: application/json Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Host: 10.222.0.42 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: Openstack-System-Scope: None Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: User-Agent: python-urllib3/1.26.12 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Auth-Token: gAAAAABjH0CJ4sTsidLqb2PYyOygujH-LKHy2w496wcJHkEudmbcgzp5q6nVEbWh7ELvVbpeqT_75YhDRkZEynMFk7TZ3mjY69kqyA9YdizV0vxHn9aL12RdGGDcFo-eOf5d8lFgmv7Vj9sIpLAUaJljC4i4GxThVFKilQpOcJHAVlKhnmwcqFA Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Id: None Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Domain-Name: None Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Identity-Status: Confirmed Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Is-Admin-Project: True Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Id: default Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Domain-Name: Default Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Project-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Role: reader,member Sep 12 14:28:40.838084 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Roles: reader,member Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/caed5793408e49edb40acad5410e02a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/caed5793408e49edb40acad5410e02a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_caed5793408e49edb40acad5410e02a9", "adminURL": "http://10.222.0.42:8080"}]}] Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Id: caed5793408e49edb40acad5410e02a9 Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-Tenant-Name: tempest-TestVolumeBootPattern-1289776979 Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Id: default Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Domain-Name: Default Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Id: c31fb669f8f14c8bbd5b7ec3450c930d Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: X-User-Name: tempest-TestVolumeBootPattern-1289776979-project Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: method: > Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: exception: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.839859 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: action_args: {'id': '80777483-7cc4-45b2-be43-d887824dc15c'} Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: {{(pid=120624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 14:28:40.840891 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. Sep 12 14:28:40.842461 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: ERROR nova.api.openstack.wsgi Sep 12 14:28:40.844145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: DEBUG nova.api.openstack.wsgi [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Returning 404 to user: Instance 80777483-7cc4-45b2-be43-d887824dc15c could not be found. {{(pid=120624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 14:28:40.844145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: INFO nova.api.openstack.requestlog [None req-da312a7b-be63-444c-91f6-e57ff4f9b3c5 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c" status: 404 len: 111 microversion: 2.1 time: 0.028919 Sep 12 14:28:40.844145 dv-cinder-820027-25-iscsi devstack@n-api.service[120624]: [pid: 120624|app: 0|req: 571/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 12 14:28:40 2022] GET /compute/v2.1/servers/80777483-7cc4-45b2-be43-d887824dc15c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 14:28:42.131873 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e62c4a4-d701-4dd2-8695-140a40217aa6 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] Calling method '.version_select at 0x7f75608a1e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 14:28:42.156171 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e62c4a4-d701-4dd2-8695-140a40217aa6 tempest-TestVolumeBootPattern-1289776979 tempest-TestVolumeBootPattern-1289776979-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-313095960" status: 202 len: 0 microversion: 2.1 time: 0.027857 Sep 12 14:28:42.157013 dv-cinder-820027-25-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 560/1131] 10.222.0.42 () {58 vars in 1260 bytes} [Mon Sep 12 14:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-313095960 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)